-- Logs begin at Wed 2022-09-14 19:01:16 UTC, end at Wed 2022-09-14 20:18:54 UTC. -- Sep 14 19:45:24.086244 dv-cinder-839768-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 19:45:24.095637 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 19:45:24 2022] *** Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: nodename: dv-cinder-839768-8-iscsi Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: machine: x86_64 Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: clock source: unix Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: pcre jit disabled Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: detected number of CPU cores: 4 Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: current working directory: / Sep 14 19:45:24.097594 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: detected binary path: /usr/bin/uwsgi-core Sep 14 19:45:24.098291 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: your processes number limit is 47680 Sep 14 19:45:24.098291 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: your memory page size is 4096 bytes Sep 14 19:45:24.098291 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: detected max file descriptor number: 2048 Sep 14 19:45:24.098291 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: lock engine: pthread robust mutexes Sep 14 19:45:24.098291 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: thunder lock: enabled Sep 14 19:45:24.098291 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 19:45:24.098291 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 19:45:24.137672 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: Python main interpreter initialized at 0x55e119f4c9c0 Sep 14 19:45:24.137672 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: python threads support enabled Sep 14 19:45:24.137672 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: your server socket listen backlog is limited to 100 connections Sep 14 19:45:24.137672 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: your mercy for graceful operations on workers is 90 seconds Sep 14 19:45:24.138012 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 19:45:24.138012 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: *** Operational MODE: preforking *** Sep 14 19:45:24.138228 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: *** uWSGI is running in multiple interpreter mode *** Sep 14 19:45:24.138228 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: spawned uWSGI master process (pid: 117786) Sep 14 19:45:24.138416 dv-cinder-839768-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 19:45:24.139440 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: spawned uWSGI worker 1 (pid: 117787, cores: 1) Sep 14 19:45:24.139440 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: spawned uWSGI worker 2 (pid: 117788, cores: 1) Sep 14 19:45:24.139440 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 19:45:24.786147 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 19:45:24.786845 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 19:45:25.860245 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:45:25.860245 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes Sep 14 19:45:25.860845 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:45:25.860845 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes Sep 14 19:45:25.862689 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:45:25.862689 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes Sep 14 19:45:25.863135 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:45:25.863135 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes Sep 14 19:45:28.351322 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:45:28.351983 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:45:28.352340 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:45:28.352431 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:45:28.352515 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:45:28.352597 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:45:28.352677 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:45:28.352752 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:45:28.352848 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:45:28.352938 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:45:28.353053 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.353191 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.353370 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.353477 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.353684 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.353775 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.354023 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.354128 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.354350 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.354449 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.354658 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.354746 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.354974 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.355068 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.355284 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.355379 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.355655 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.356255 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.356411 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.356513 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.356717 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.356808 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.357039 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-8-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.357136 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-8-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.357357 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.357456 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.357662 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.357750 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.357994 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.358095 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.358309 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.358406 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.358610 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.358699 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.358928 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.359056 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.359228 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.359368 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.359718 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.359863 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.360155 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.360269 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.360457 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.360550 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.360763 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.360863 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.361095 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.361196 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.361405 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.361495 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.361714 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.361845 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.362058 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.362171 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.362366 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.362461 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.362688 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.362900 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.363057 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.363228 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.363389 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-8-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.363528 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-8-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.363686 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.363840 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.363981 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.364128 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.364293 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.364410 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.364699 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.364810 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.365004 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.365109 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.365308 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.365403 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.365623 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.365714 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.365966 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.366076 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.366316 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.366407 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.366595 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.366692 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.366910 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.366998 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.367226 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.367312 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.367540 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.367625 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.367839 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.367926 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.368142 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.368227 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.368447 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.368541 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.368761 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.368858 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.369062 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.369148 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.369366 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.369479 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.369614 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.369711 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.369935 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.370025 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.370255 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.370359 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.370571 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.370657 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.370891 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.370980 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.371170 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.371275 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.371417 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.371512 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.371735 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.371848 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.372088 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.372184 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.372393 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.372486 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.372698 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.372807 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.373004 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.373101 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.373304 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.373390 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.373606 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.373701 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.373930 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.374020 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.374235 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.374334 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.374537 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.374639 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.374851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.374946 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.375162 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.375248 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.375475 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.375570 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.375777 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.375863 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.376093 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.376180 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.376485 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.376580 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.376752 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.376840 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.377023 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.377159 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.377354 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.377450 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.377668 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.377762 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.377998 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.378087 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.378315 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.378410 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.378628 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.378715 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.378929 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.379021 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.379228 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.379316 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.379528 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.379625 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.379843 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.379929 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.380169 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.380256 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.380470 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.380563 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.380717 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.380811 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.381012 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.381098 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.381309 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.381408 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.381622 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.381721 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.381946 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.382047 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.382248 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.382336 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.382546 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.382641 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.382845 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.382933 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.383149 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.383247 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.383447 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.383544 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.383747 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.383842 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.384045 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.384133 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.384346 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.384434 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.384647 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.384733 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.384945 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.385040 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.385244 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.385331 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.385543 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.385646 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.385863 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.385970 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.386183 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.386278 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.386519 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.386624 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.386825 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.386921 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.387133 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.387226 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.387433 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.387539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.387735 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.387827 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.388046 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.388139 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.388349 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.388448 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.388651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.388745 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.388964 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.389056 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.389265 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.389356 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.389564 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.389666 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.389896 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.390002 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.390199 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.390287 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.390500 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.390586 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.390812 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.390901 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.391107 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.391202 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.391406 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.391501 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.391718 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.391812 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.392020 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.392114 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.392319 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.392415 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.392615 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.392708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.392916 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.393011 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.393214 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.393319 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.393510 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.393605 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.393841 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.393943 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.394127 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.394223 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.394423 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.394510 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.394734 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.394823 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.395049 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.395216 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.395354 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.395441 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.395653 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.395739 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.395953 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.396049 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.396266 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.396359 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:45:28.396594 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.396808 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397109 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397195 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397276 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397362 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397544 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397633 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397890 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.397982 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.398219 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.398305 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.398534 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.398633 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.398840 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.398934 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.399146 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.399245 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.399467 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.399563 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.399773 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.399859 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.400079 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.400164 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.400385 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.400488 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.400696 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.400806 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.401008 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.401109 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.401335 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.401431 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.401648 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.401745 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.401984 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.402110 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.402298 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.402880 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.403117 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.403206 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.403433 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.403522 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.403756 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.403856 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.404071 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.404166 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.404378 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.404466 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.404714 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.404809 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.405053 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.405148 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.405363 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.405457 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.405682 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.405770 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.406021 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.406120 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.406329 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.406415 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.406636 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.406742 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.406941 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.407030 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.407277 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.407364 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.407585 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.407673 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.407890 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.407976 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.408202 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.408304 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.408508 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.408595 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.408826 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.408919 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.409133 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.409232 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.409439 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.409536 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.409744 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.409900 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.410074 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.410171 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.410379 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.410472 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.410709 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.410796 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.411018 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.411113 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.411335 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.411466 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.411644 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.411738 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.411948 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.412048 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.412258 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.412344 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.412563 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.412650 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.412869 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.412957 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.413171 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.413266 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.413472 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.413558 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.413771 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.413920 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.414097 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.414184 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.414400 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.414487 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.414700 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.414787 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.415012 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.415097 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.415333 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.415421 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.415635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.415732 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.415961 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.416057 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.416262 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.416358 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.416566 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.416660 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.416870 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.416963 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.417175 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.417275 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.417477 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.417571 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.417780 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.417941 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.418167 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.418841 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.418970 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.419059 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.419291 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.419378 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.419595 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.419691 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.419896 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.420020 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.420212 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.420298 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.420513 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.420602 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.420814 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.420901 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.421124 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.421210 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.421430 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.421518 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.421735 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.421864 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.422070 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.422158 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.422375 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.422464 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.422694 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.422780 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.423000 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.423086 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.423307 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.423406 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.423633 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.423727 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.423958 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.424055 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.424260 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.424348 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.424579 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.424666 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.424898 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.424992 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.425209 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.425304 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.425506 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.425593 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.425831 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.425934 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.426125 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.426212 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.426424 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.426518 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.426724 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.426819 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.427027 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.427114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.427327 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.427414 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.427625 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.427719 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.427922 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.428010 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.428223 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.428316 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.428526 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.428614 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.428839 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.428925 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.429145 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.429232 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.429443 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.429531 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.429741 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.429853 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.430066 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.430163 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.430401 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.430496 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.430702 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.430789 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.431037 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.431134 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.431368 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.431461 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.431681 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.431767 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.431998 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.432092 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.432305 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.432392 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.432618 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.432705 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.432922 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.433023 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.433229 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.433316 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.433536 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.433623 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.433889 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.433994 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.434210 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.434305 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.434518 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.434612 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.434835 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.434931 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.435141 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.435236 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.435458 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.435545 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.435765 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.435852 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.436076 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.436162 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.436377 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.436463 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.436686 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.436774 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.437025 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.437151 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.437354 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.437440 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.437666 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.437753 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.438011 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.438109 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.438316 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.438403 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.438627 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.438715 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.438931 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.439016 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.439238 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.439337 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.439542 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.439629 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.439846 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.439935 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.440162 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.440258 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.440466 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.440553 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.440779 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.440865 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.441083 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.441179 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.441402 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.441488 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.441706 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.441792 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.442044 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.442144 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.442617 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.442705 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.442928 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.443014 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.443255 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.443343 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.443584 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.443677 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.443888 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.443975 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.444194 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.444282 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.444509 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.444603 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.444815 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.444902 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.445121 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.445217 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.445428 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.445522 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.445728 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.445841 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.446055 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.446150 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.446363 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.446453 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.446675 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.446776 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.446983 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.447070 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.447290 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.447379 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.447591 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.447778 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.447904 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.447992 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.448296 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.448511 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.448608 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.448814 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.448904 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.449119 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.449205 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.449461 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.449558 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.449769 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.449910 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.450111 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.450199 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.450431 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.450533 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.450733 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.450819 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.451033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.451126 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.451352 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.451446 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.451657 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.451788 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.451957 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.452054 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.452260 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.452348 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.452562 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.452648 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.452900 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.452987 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.453207 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.453301 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.453506 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.453593 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.453833 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.453977 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.454157 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.454245 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.454465 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.454558 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.454775 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.454875 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.455081 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.455169 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.455387 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.455473 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.455705 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.455801 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.456013 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.456109 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.456320 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.456408 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.456628 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.456723 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.456934 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.457022 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.457239 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.457360 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.457544 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.457640 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.457887 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.457976 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.458195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.458281 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.458501 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.458589 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.458805 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.458891 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.459106 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.459194 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.459410 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.459497 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.459721 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.459807 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.460280 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.460369 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.460607 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.460695 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.460919 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.461014 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.461232 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.461319 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.461570 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.461667 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.461914 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.462019 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.462245 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.462333 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.462571 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.462659 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.462886 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.462975 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.463191 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.463284 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.463498 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.463587 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.463800 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.463889 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.464103 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.464189 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.464409 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.464497 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.464709 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.464804 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.465529 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.465630 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.465855 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.465958 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.466168 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.466262 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.466469 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.466556 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.466770 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.466874 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.467070 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.467156 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.467370 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.467510 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.467680 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.467777 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.467980 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.468068 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.468286 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.468381 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.468585 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.468681 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.468903 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.468990 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.469206 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.469293 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.469508 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.469596 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.469835 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.469924 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.470128 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.470214 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.470465 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.470605 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.470766 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.470861 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.471097 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.471186 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.471422 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.471509 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.471757 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.471844 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.472058 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.472220 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.472358 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.472444 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.472680 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.472773 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.472982 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.473086 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.473282 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.473369 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.473577 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.473664 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.473907 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.474016 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.474213 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.474303 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.474512 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.474605 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.474817 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.474912 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.475120 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.475215 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.475424 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.475511 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.475727 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.475815 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.476025 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.476110 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.476329 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.476416 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.476629 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.476717 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.476937 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.477038 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.477243 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.477332 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.477543 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.477630 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.477863 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.477952 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.478173 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.478260 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.478479 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.478577 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.478778 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.478865 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.479082 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.479176 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.479380 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.479469 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.479691 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.479777 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.479991 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.480090 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.480291 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.480379 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.481125 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.481268 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.481442 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.481542 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.481748 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.481903 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.482074 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.482170 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.482392 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.482490 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.482699 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.482794 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.482998 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.483093 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.483298 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.483396 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.483604 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.483691 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.483903 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.483990 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.484200 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.484288 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.484502 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.484590 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.484818 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.484913 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.485128 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.485217 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.485427 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.485520 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.485730 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.485836 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.486054 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.486152 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.486355 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.486442 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.486654 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.486749 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.486960 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.487048 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.487261 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.487349 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.487560 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.487709 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.487858 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.487946 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.488158 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.488244 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.488458 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.488552 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.488775 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.488862 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.489078 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.489164 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.489381 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.489477 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.489680 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.489767 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.490003 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.490091 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.490343 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.490445 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.490643 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.490740 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.490995 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.491082 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.491296 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.491384 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.491604 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.491690 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.491918 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.492005 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.492223 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.492311 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.492528 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.492623 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.492835 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.492923 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.493134 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.493229 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.493443 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.493530 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.493749 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.493856 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.494083 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.494173 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.494383 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.494477 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.494683 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.494787 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.495001 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.495089 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.495307 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.495401 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.495612 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.495710 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.495930 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.496016 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.496274 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.496366 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.496597 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.496692 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.496897 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.496984 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.497202 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.497296 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.497508 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.497606 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.497838 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.497929 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.498142 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.498231 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.498450 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.498539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.498756 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.498850 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.499064 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.499150 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.499372 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.499461 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.499676 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.499763 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.499981 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.500068 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.500281 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.500376 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.500585 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.500679 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.500890 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.500977 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.501191 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.501286 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.501508 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.501594 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.501820 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.501921 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.502122 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.502210 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.502430 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.502517 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.502731 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.502834 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.503036 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.503132 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.503335 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.503428 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.503753 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.503855 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.504059 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.504147 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.504363 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.504508 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.504665 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.504761 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.504971 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.505058 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.505276 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.505369 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.505586 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.505674 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.505919 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.506009 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.506221 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.506321 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.506631 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.506727 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.506939 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.507036 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.507247 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.507334 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.507553 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.507641 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.507854 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.507939 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.508158 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.508300 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.508465 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.508616 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.508788 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.508937 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.509095 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.509242 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.509402 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.509545 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.509706 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.509869 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.510049 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.510192 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.510354 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.510494 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.510672 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.510812 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.511091 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.511230 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.511404 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.511530 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.511710 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.511857 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.512162 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.512261 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.512473 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.512562 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.512783 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.512894 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.513108 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.513197 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.513431 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.513528 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.513758 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.513871 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.514088 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.514177 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.514405 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.514536 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.514712 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.514810 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.515033 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.515122 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.515354 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.515449 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.515662 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.515749 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.515971 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.516058 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.516274 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.516371 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.516592 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.516680 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.516911 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.516998 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.517221 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.517322 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.517543 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.517631 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.517987 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.518098 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.518308 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.518396 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.518613 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.518702 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.518929 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.519030 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.519247 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.519335 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.519550 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.519637 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.519851 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.519947 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.520158 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.520246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.520459 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.520547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.520759 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.520855 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.521078 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.521166 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.521379 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.521466 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.521684 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.521772 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.522015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.522103 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.522320 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.522407 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.522621 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.522710 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.522921 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.523015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.523238 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.523326 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.523537 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.523633 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.523854 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.523942 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.524161 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.524249 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.524481 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.524567 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.524796 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.524890 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.525099 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.525196 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.525417 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.525507 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.525722 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.525859 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.526048 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.526147 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.526351 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.526438 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.526650 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.526736 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.526988 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.527083 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.527287 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.527375 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.528137 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.528234 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.528466 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.528564 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.528793 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.528879 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.529102 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.529188 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.529431 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.529527 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.529752 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.529868 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.530094 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.530188 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.530401 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.530490 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.530713 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.530800 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.531033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.531120 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.531334 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.531422 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.531632 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.531771 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.531937 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.532033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.532233 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.532322 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.532531 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.532617 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.532832 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.532929 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.533137 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.533223 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.533435 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.533522 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.533733 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.533882 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.534058 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.534148 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.534379 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.534467 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.534678 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.534779 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.534994 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.535089 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.535300 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.535388 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.535601 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.535696 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.535899 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.535986 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.536196 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.536291 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.536534 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.536624 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.536830 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.536916 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.537149 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.537235 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.537456 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.537544 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.537775 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.537922 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.538111 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.538197 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.538420 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.538550 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.538729 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.538817 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.539038 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.539132 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.539348 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.539438 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.539657 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.539752 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.539967 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.540063 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.540270 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.540370 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.540580 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.540668 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.540889 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.541023 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.541198 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.541286 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.541706 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.541870 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.542058 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.542157 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.542372 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.542460 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.542683 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.542777 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.542994 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.543135 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.543849 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.543939 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.544164 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.544253 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.544473 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.544564 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.544782 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.544870 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.545090 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.545178 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.545400 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.545489 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.545721 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.545827 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.546064 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.546156 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.546386 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.546476 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.546718 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.546806 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.547029 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.547125 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.547341 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.547441 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.547650 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.547737 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.547958 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.548059 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.548305 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.548396 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.548618 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.548714 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.548920 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.549010 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.549231 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.549320 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.549542 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.549632 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.549876 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.549970 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.550188 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.550279 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.550495 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.550590 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.550804 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.550892 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.551113 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.551209 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.551419 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.551516 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.551727 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.551816 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.552035 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.552124 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.552343 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.552439 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.552662 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.552756 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.552990 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.553077 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.553308 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.553398 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.553618 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.553706 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.553952 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.554043 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.554268 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.554357 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.554775 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.554861 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.555086 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.555172 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.555414 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.555503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.555735 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.555822 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.556057 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.556145 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.556367 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.556456 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.556678 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.556764 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.556997 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.557094 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.557300 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.557389 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.557601 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.557696 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.557931 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.558037 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.558241 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.558328 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.558542 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.558654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.558883 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.558981 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.559194 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.559283 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.559495 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.559588 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.559813 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.559910 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.560117 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.560204 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.560639 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.560727 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.560975 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.561071 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.561284 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.561379 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.561606 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.561695 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.561953 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.562088 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.562268 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.562366 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.562570 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.562657 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.562891 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.562979 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.563196 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.563284 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.563499 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.563586 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.563815 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.563905 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.564124 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.564212 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.564427 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.564524 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.564730 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.564826 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.565039 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.565125 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.565344 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.565444 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.565644 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.565731 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.565974 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.566062 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.566275 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.566379 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.566595 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.566683 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.566898 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.566998 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.567199 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.567557 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.567761 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.567847 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.568068 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.568155 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.568368 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.568493 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.568669 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.568755 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.568968 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.569067 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.569273 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.569361 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.569584 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.569670 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.569909 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.570000 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.570217 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.570313 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.570521 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.570608 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.570826 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.570912 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.571174 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.571269 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.571479 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.571565 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.571780 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.571875 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.572098 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.572185 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.572399 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.572487 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.572701 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.572802 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.573012 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.573108 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.573320 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.573407 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.573639 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.573736 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.573972 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.574063 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.574302 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.574394 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.574654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.574754 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.574968 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.575055 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.575494 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.575583 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.575826 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.575914 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.576142 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.576237 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.576471 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.576559 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.576800 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.576888 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.577104 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.577194 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.577409 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.577510 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.577713 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.577819 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.578058 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.578156 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.578366 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.578461 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.578675 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.578770 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.578980 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.579068 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.579287 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.579382 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.579594 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.579683 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.579899 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.579993 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.580205 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.580305 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.580511 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.580598 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.580815 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.580903 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.581120 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.581216 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.581424 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.581519 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.581729 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.581865 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.582060 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.582152 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.582365 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.582452 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.582676 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.582765 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.583013 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.583102 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.583324 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.583412 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.583636 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.583722 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.583946 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.584035 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.584258 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.584346 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.584564 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.584660 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.584869 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.584957 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.585172 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.585258 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.585478 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.585639 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.585788 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.585893 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.586141 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.586234 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.586449 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.586549 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.586752 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.586839 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.587393 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.587490 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.587708 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.587796 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.588024 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.588120 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.588342 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.588429 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.588649 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.588738 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.588974 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.589061 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.589299 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.589387 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.589605 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.589693 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.590454 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.590564 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.590766 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.590863 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.591095 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.591187 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.591430 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.591525 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.591755 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.591851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.592078 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.592166 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.592381 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.592468 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.592682 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.592782 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.592983 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.593070 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.593290 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.593375 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.593603 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.593692 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.593932 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.594022 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.594235 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.594323 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.594538 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.594628 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.594842 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.594929 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.595141 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.595227 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.595437 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.595526 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.595736 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.595822 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.596033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.596120 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.596337 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.596426 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.596635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.596722 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.596934 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.597033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.597230 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.597317 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.597528 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.597615 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.597847 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.597983 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.598149 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.598249 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.598455 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.598544 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.598755 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.598852 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.599054 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.599187 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.599352 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.599449 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.599650 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.599746 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.599948 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.600043 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.600273 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.600368 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.600599 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.600695 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.600908 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.600997 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.601226 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.601314 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.601574 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.601670 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.601871 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.601962 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.602179 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.602267 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.602497 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.602586 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.602813 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.602945 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.603122 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.603210 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.603427 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.603516 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.603754 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.603844 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.604058 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.604154 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.604365 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.604460 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.604670 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.604759 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.604975 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.605071 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.605280 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.605367 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.605628 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.606250 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.606475 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.606573 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.606797 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.606887 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.607100 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.607191 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.607420 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.607516 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.607732 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.607827 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.608046 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.608134 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.608355 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.608445 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.608661 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.608748 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.608986 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.609072 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.609292 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.609387 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.609595 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.609689 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.609928 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.610033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.610236 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.610325 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.610541 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.610627 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.610853 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.610948 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.611160 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.611255 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.611464 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.611551 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.611773 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.611868 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.612085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.612173 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.612406 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.612500 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.612727 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.612823 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.613033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.613130 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.613353 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.613447 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.613676 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.613766 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.614043 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.614132 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.614352 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.614438 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.614691 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.614780 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.615016 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.615102 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.615325 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.615419 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.615633 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.615730 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.615931 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.616020 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:45:28.616169 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:45:28.616266 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:45:28.768502 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Registered counter for database nova_api Sep 14 19:45:28.768700 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Registered counter for database nova_api Sep 14 19:45:28.790245 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:28.793609 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:28.796948 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:28.800081 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:28.852370 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.context [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0995e957-b33c-4c22-b06d-cfa91799dd59(cell1) {{(pid=117788) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:45:28.855751 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.context [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0995e957-b33c-4c22-b06d-cfa91799dd59(cell1) {{(pid=117787) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:45:28.856227 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:45:28.856697 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:45:28.858273 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:45:28.858993 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:45:28.859430 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:45:28.859645 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:45:28.860115 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:45:28.861423 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:45:28.861671 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:45:28.862415 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:45:28.862860 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:45:28.863436 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Registered counter for database nova_cell0 Sep 14 19:45:28.864850 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:45:28.866882 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Registered counter for database nova_cell0 Sep 14 19:45:28.867561 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Registered counter for database nova_cell1 Sep 14 19:45:28.871193 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Registered counter for database nova_cell1 Sep 14 19:45:28.874500 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:28.875744 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:28.877633 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:28.882413 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:28.883160 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:28.883806 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:29.015936 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:29.022273 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:29.025883 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Registered counter for database nova_cell0 Sep 14 19:45:29.031301 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Registered counter for database nova_cell0 Sep 14 19:45:29.035281 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:29.039762 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:45:29.039941 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:29.044535 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:45:29.491253 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:45:29.498973 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:45:29.524177 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:45:29.531430 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:45:29.836934 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:45:29.842881 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:45:29.848105 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e119f4c9c0 pid: 117788 (default app) Sep 14 19:45:29.850169 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:45:29.851340 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Sep 14 19:45:29.851757 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Wed Sep 14 19:45:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:45:29.870941 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:45:29.877450 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-68936fb9-c1bc-46bb-8abd-fffa48815fb4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:45:29.882736 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e119f4c9c0 pid: 117787 (default app) Sep 14 19:46:52.067034 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:52.068047 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Sep 14 19:46:52.068639 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:52.080958 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:52.090807 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:52.090807 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:52.090807 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:52.981157 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5dd55db1-5a7c-4eae-91eb-fb443fff118a admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:53.012453 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5dd55db1-5a7c-4eae-91eb-fb443fff118a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.936558 Sep 14 19:46:53.013217 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 19:46:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:46:55.601250 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:55.602809 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3040ffe5-6401-41bb-8fff-ba1e977b201e None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001373 Sep 14 19:46:55.603369 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:56.049231 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-579e0dd8-37dd-496e-a189-ce7c3a1a71ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:46:56.162503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-579e0dd8-37dd-496e-a189-ce7c3a1a71ee admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.553172 Sep 14 19:46:56.163083 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:46:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:46:56.177295 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:56.178281 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:56.180331 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:56.181068 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:46:56.389345 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a4c643f7-f36d-4559-9bab-73dcb09399d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:46:56.566830 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a4c643f7-f36d-4559-9bab-73dcb09399d5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.393974 Sep 14 19:46:56.567424 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 19:46:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:46:59.154536 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-579e0dd8-37dd-496e-a189-ce7c3a1a71ee admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:46:59.156123 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-579e0dd8-37dd-496e-a189-ce7c3a1a71ee admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Sep 14 19:46:59.156975 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:46:59.788981 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1813deac-b4a4-4a57-922c-fc6fdd3dc7b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 5, "ram": 512, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:46:59.886670 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1813deac-b4a4-4a57-922c-fc6fdd3dc7b6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.723517 Sep 14 19:46:59.887445 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:46:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:46:59.900424 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4c989c80-725b-4468-875e-36f6c3126df8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:00.065568 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4c989c80-725b-4468-875e-36f6c3126df8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.169472 Sep 14 19:47:00.066188 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 19:46:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:02.678719 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1813deac-b4a4-4a57-922c-fc6fdd3dc7b6 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:02.679777 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1813deac-b4a4-4a57-922c-fc6fdd3dc7b6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 14 19:47:02.680176 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:03.095190 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c580549b-bd47-489e-89cb-12ccfa8d0f19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:03.175850 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c580549b-bd47-489e-89cb-12ccfa8d0f19 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489369 Sep 14 19:47:03.176403 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:03.189197 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3bcf281a-f36b-401a-b4bb-1bb331a4a61a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:03.277856 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3bcf281a-f36b-401a-b4bb-1bb331a4a61a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091971 Sep 14 19:47:03.278110 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 19:47:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:05.877455 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c580549b-bd47-489e-89cb-12ccfa8d0f19 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:05.878500 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c580549b-bd47-489e-89cb-12ccfa8d0f19 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 14 19:47:05.879096 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:06.291835 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d92ce483-5f9a-4718-aa37-44fa9d74ef61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:06.420186 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d92ce483-5f9a-4718-aa37-44fa9d74ef61 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534538 Sep 14 19:47:06.420760 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:06.433769 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ad1d3371-f8a1-4073-8582-dbb2e47c2351 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:06.534507 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ad1d3371-f8a1-4073-8582-dbb2e47c2351 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105361 Sep 14 19:47:06.535209 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 19:47:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:09.140131 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d92ce483-5f9a-4718-aa37-44fa9d74ef61 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:09.141141 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d92ce483-5f9a-4718-aa37-44fa9d74ef61 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 14 19:47:09.141703 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:09.549549 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7dabf89e-c56d-41cc-94e7-44b05d86de35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:09.634780 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7dabf89e-c56d-41cc-94e7-44b05d86de35 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487114 Sep 14 19:47:09.635500 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:09.649109 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-73f64f95-e3fa-43c5-b5ee-671d3c283613 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:09.735297 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-73f64f95-e3fa-43c5-b5ee-671d3c283613 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090955 Sep 14 19:47:09.741183 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Wed Sep 14 19:47:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:12.350072 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7dabf89e-c56d-41cc-94e7-44b05d86de35 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:12.351634 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7dabf89e-c56d-41cc-94e7-44b05d86de35 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 14 19:47:12.352146 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:12.771315 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-404c2684-5340-4d69-a8cc-a9cbccaf0b87 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:12.796202 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-404c2684-5340-4d69-a8cc-a9cbccaf0b87 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438334 Sep 14 19:47:12.796838 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 19:47:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:47:15.379320 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7dabf89e-c56d-41cc-94e7-44b05d86de35 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:15.380369 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7dabf89e-c56d-41cc-94e7-44b05d86de35 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 14 19:47:15.380773 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:47:15.776642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d590b5e1-a60e-40d8-88ca-56a39f96e4f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:15.896955 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d590b5e1-a60e-40d8-88ca-56a39f96e4f9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.510099 Sep 14 19:47:15.897595 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:15.909660 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-83d1bcc3-fd5c-4547-a84d-a1d0454242b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:16.024931 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-83d1bcc3-fd5c-4547-a84d-a1d0454242b5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118884 Sep 14 19:47:16.025527 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 19:47:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:18.590960 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d590b5e1-a60e-40d8-88ca-56a39f96e4f9 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:18.591962 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d590b5e1-a60e-40d8-88ca-56a39f96e4f9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 14 19:47:18.592364 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:18.960745 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-79345293-6058-48fe-bdcd-462865268458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:19.071814 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-79345293-6058-48fe-bdcd-462865268458 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473415 Sep 14 19:47:19.072371 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:19.084322 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-259527a5-dde5-4d7a-b532-45ceca34ccd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:19.137490 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-259527a5-dde5-4d7a-b532-45ceca34ccd3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056790 Sep 14 19:47:19.138102 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 19:47:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:22.022950 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-79345293-6058-48fe-bdcd-462865268458 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:22.023876 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-79345293-6058-48fe-bdcd-462865268458 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 14 19:47:22.024515 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:22.486697 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5fa89339-f651-4692-b1fe-adfb91665a6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "swap": 0, "disk": 40, "ram": 4096}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:22.552017 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5fa89339-f651-4692-b1fe-adfb91665a6e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.521284 Sep 14 19:47:22.552575 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:22.567238 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-93b17e82-9f68-461e-bc0e-293cb29a2d51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:22.572467 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:22.691937 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-93b17e82-9f68-461e-bc0e-293cb29a2d51 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130718 Sep 14 19:47:22.692776 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 19:47:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:25.347522 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5fa89339-f651-4692-b1fe-adfb91665a6e admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:25.349313 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5fa89339-f651-4692-b1fe-adfb91665a6e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Sep 14 19:47:25.349993 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:25.784804 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6566f469-230a-465f-bc1e-c63831f3a5c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:25.866806 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6566f469-230a-465f-bc1e-c63831f3a5c0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509661 Sep 14 19:47:25.874564 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:25.879706 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-356bc7a7-f75a-4b39-8c64-cdda786c9237 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:25.988805 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-356bc7a7-f75a-4b39-8c64-cdda786c9237 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112839 Sep 14 19:47:25.996005 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 19:47:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:47:28.689170 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6566f469-230a-465f-bc1e-c63831f3a5c0 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:28.690860 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6566f469-230a-465f-bc1e-c63831f3a5c0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Sep 14 19:47:28.691507 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:29.129453 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9d37f9c7-45d0-490d-bb01-2f415d0ff41d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "disk": 160}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:29.137826 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:29.266090 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9d37f9c7-45d0-490d-bb01-2f415d0ff41d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.567784 Sep 14 19:47:29.266826 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Wed Sep 14 19:47:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:29.279034 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b08f8d9-644c-4161-b3f3-6a61854a8f91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:29.370888 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b08f8d9-644c-4161-b3f3-6a61854a8f91 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095415 Sep 14 19:47:29.371642 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Wed Sep 14 19:47:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:47:46.624385 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9d37f9c7-45d0-490d-bb01-2f415d0ff41d admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:46.625421 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9d37f9c7-45d0-490d-bb01-2f415d0ff41d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 14 19:47:46.625846 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:46.636823 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:47:47.011526 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ab5f0af0-f436-43e0-94e0-39054813083d admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:47.029677 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ab5f0af0-f436-43e0-94e0-39054813083d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397339 Sep 14 19:47:47.030260 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 19:47:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:47:48.335958 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9d37f9c7-45d0-490d-bb01-2f415d0ff41d admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.337001 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9d37f9c7-45d0-490d-bb01-2f415d0ff41d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 14 19:47:48.337376 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:48.849617 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d751b2f1-0494-4359-8656-faa7c73234c1 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.855004 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-d751b2f1-0494-4359-8656-faa7c73234c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d751b2f1-0494-4359-8656-faa7c73234c1 admin admin] Request method failure captured: Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Accept: application/json Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Accept-Encoding: gzip, deflate Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Connection: keep-alive Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Content-Length: 0 Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Host: 10.222.0.42 Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Openstack-Api-Version: compute 2.92 Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: User-Agent: python-novaclient Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABjIi_k7yYXBOptn-IegAiXrO2r3zp05wFQe20aIToVxTLVC-pyra4jQ2rwwjIwn7d3hUK3nGGl5hZkgbOqr3H64UU50xWfyI0qoBc_jw8zKKkjRP1u6_YFMOw4EZiaO4LJB0bSi4duFGtGNvdOqEt8Ra5fcJO0f13Fw5gWKBGVA39kYSs Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Name: admin Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Role: member,reader,admin Sep 14 19:47:48.858254 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Roles: member,reader,admin Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8f053b53ae4aff97a668669e77d899", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}] Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant: admin Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant-Name: admin Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User: admin Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Id: e8f45104d2d540658c4bbc32613a9317 Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Name: admin Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: method: > Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: exception: Flavor 42 could not be found. Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: action_args: {'id': '42'} Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:47:48.859851 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:48.861015 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.862539 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d751b2f1-0494-4359-8656-faa7c73234c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:47:48.863829 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d751b2f1-0494-4359-8656-faa7c73234c1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.385386 Sep 14 19:47:48.863829 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 19:47:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:48.870264 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa6c5505-a5f8-4acc-a605-b4b83ea55eab admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.892487 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa6c5505-a5f8-4acc-a605-b4b83ea55eab admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026125 Sep 14 19:47:48.894783 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 19:47:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:47:48.903790 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8ae152cd-8b57-47fa-92ed-84912810ae52 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.927497 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8ae152cd-8b57-47fa-92ed-84912810ae52 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028233 Sep 14 19:47:48.928688 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 19:47:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:47:48.940550 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a0f5ce2d-0ef6-4c89-bd91-ce3ccebcbf6d admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:48.946287 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-a0f5ce2d-0ef6-4c89-bd91-ce3ccebcbf6d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a0f5ce2d-0ef6-4c89-bd91-ce3ccebcbf6d admin admin] Request method failure captured: Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Accept: application/json Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Accept-Encoding: gzip, deflate Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Connection: keep-alive Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Content-Length: 0 Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Host: 10.222.0.42 Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Openstack-Api-Version: compute 2.92 Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: User-Agent: python-novaclient Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABjIi_k7yYXBOptn-IegAiXrO2r3zp05wFQe20aIToVxTLVC-pyra4jQ2rwwjIwn7d3hUK3nGGl5hZkgbOqr3H64UU50xWfyI0qoBc_jw8zKKkjRP1u6_YFMOw4EZiaO4LJB0bSi4duFGtGNvdOqEt8Ra5fcJO0f13Fw5gWKBGVA39kYSs Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Name: admin Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Role: member,reader,admin Sep 14 19:47:48.949635 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Roles: member,reader,admin Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8f053b53ae4aff97a668669e77d899", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}] Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant: admin Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant-Name: admin Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User: admin Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Id: e8f45104d2d540658c4bbc32613a9317 Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Name: admin Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: method: > Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: exception: Flavor 42 could not be found. Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: action_args: {'id': '42'} Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:47:48.951195 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:48.952167 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:48.953246 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a0f5ce2d-0ef6-4c89-bd91-ce3ccebcbf6d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:47:48.961913 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a0f5ce2d-0ef6-4c89-bd91-ce3ccebcbf6d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014473 Sep 14 19:47:48.961913 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 19:47:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:50.157924 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8ae152cd-8b57-47fa-92ed-84912810ae52 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.158941 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8ae152cd-8b57-47fa-92ed-84912810ae52 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 14 19:47:50.159363 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:50.674474 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6bc01f47-c6ea-413c-8c82-e5ae2891697c admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.679575 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-6bc01f47-c6ea-413c-8c82-e5ae2891697c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6bc01f47-c6ea-413c-8c82-e5ae2891697c admin admin] Request method failure captured: Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Accept: application/json Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Accept-Encoding: gzip, deflate Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Connection: keep-alive Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Content-Length: 0 Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Host: 10.222.0.42 Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Openstack-Api-Version: compute 2.92 Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: User-Agent: python-novaclient Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABjIi_mIWguMqky8xU0x9bDSZ7ZU5y_j_IRhz8mLLXrnX7A0GDa9xqidvPkRcrYRbIiPwmAyBLDow6lWUpMpedMYCzBpPIu5Qd4OeE0TwzoKisMSDx7NIhNpL6DcGv-u8qHuhmSfhY5KzNl9NGFPO473KbPNAXdG9Wtl4lUZLPKmWu5m5M Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Name: admin Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Role: member,reader,admin Sep 14 19:47:50.681085 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Roles: member,reader,admin Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8f053b53ae4aff97a668669e77d899", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}] Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant: admin Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant-Name: admin Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User: admin Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Id: e8f45104d2d540658c4bbc32613a9317 Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Name: admin Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: method: > Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: exception: Flavor 84 could not be found. Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: action_args: {'id': '84'} Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:47:50.682642 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:50.683523 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.684736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6bc01f47-c6ea-413c-8c82-e5ae2891697c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:47:50.686002 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6bc01f47-c6ea-413c-8c82-e5ae2891697c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387545 Sep 14 19:47:50.686002 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 19:47:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:50.692471 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5ffc2d7d-d17c-488e-9b2b-635b818d82c1 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.707743 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5ffc2d7d-d17c-488e-9b2b-635b818d82c1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019040 Sep 14 19:47:50.708267 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 19:47:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:47:50.718063 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2448aa0a-8007-4cad-a2d7-5120f31e67c9 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.733217 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2448aa0a-8007-4cad-a2d7-5120f31e67c9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018564 Sep 14 19:47:50.733736 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 19:47:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:47:50.743297 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f5b76c5-8137-406e-919f-941269fa5e99 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:50.748171 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-0f5b76c5-8137-406e-919f-941269fa5e99 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f5b76c5-8137-406e-919f-941269fa5e99 admin admin] Request method failure captured: Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Accept: application/json Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Accept-Encoding: gzip, deflate Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Connection: keep-alive Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Content-Length: 0 Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Host: 10.222.0.42 Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Openstack-Api-Version: compute 2.92 Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: User-Agent: python-novaclient Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABjIi_mIWguMqky8xU0x9bDSZ7ZU5y_j_IRhz8mLLXrnX7A0GDa9xqidvPkRcrYRbIiPwmAyBLDow6lWUpMpedMYCzBpPIu5Qd4OeE0TwzoKisMSDx7NIhNpL6DcGv-u8qHuhmSfhY5KzNl9NGFPO473KbPNAXdG9Wtl4lUZLPKmWu5m5M Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Name: admin Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Role: member,reader,admin Sep 14 19:47:50.749666 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Roles: member,reader,admin Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8f053b53ae4aff97a668669e77d899", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}] Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant: admin Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant-Name: admin Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User: admin Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Id: e8f45104d2d540658c4bbc32613a9317 Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Name: admin Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: method: > Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: exception: Flavor 84 could not be found. Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: action_args: {'id': '84'} Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:47:50.751230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:50.752206 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:50.753503 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f5b76c5-8137-406e-919f-941269fa5e99 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:47:50.754774 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0f5b76c5-8137-406e-919f-941269fa5e99 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011723 Sep 14 19:47:50.754774 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Wed Sep 14 19:47:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 14 19:47:51.957022 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2448aa0a-8007-4cad-a2d7-5120f31e67c9 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:51.958063 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2448aa0a-8007-4cad-a2d7-5120f31e67c9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 14 19:47:51.958467 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:52.472693 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5aa2e89f-c46a-4f51-a251-fa87666b40f7 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.478549 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-5aa2e89f-c46a-4f51-a251-fa87666b40f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5aa2e89f-c46a-4f51-a251-fa87666b40f7 admin admin] Request method failure captured: Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Accept: application/json Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Accept-Encoding: gzip, deflate Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Connection: keep-alive Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Content-Length: 0 Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Host: 10.222.0.42 Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Openstack-Api-Version: compute 2.92 Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: User-Agent: python-novaclient Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABjIi_n4_cWRLEmilphL6ZzgtGyFurpT8OOi9fDcT5M7kq-4Y8CAp4T20NE0HMhNO6iinccWh3L-MxQEgQ2eqnIl8cPZjbqd98w_CjS4ud1BL7INXJsmLTmbQmbA5cmS61r4eJwPIVs3ubiIjEdak494WkVq7-QNzkQj9e1q9ILgCZ4tD4 Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Project-Name: admin Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Role: member,reader,admin Sep 14 19:47:52.480114 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Roles: member,reader,admin Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8f053b53ae4aff97a668669e77d899", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}] Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant: admin Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-Tenant-Name: admin Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User: admin Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Id: e8f45104d2d540658c4bbc32613a9317 Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: X-User-Name: admin Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: method: > Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: exception: Flavor 451 could not be found. Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: action_args: {'id': '451'} Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:47:52.481654 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:52.482491 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.483547 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5aa2e89f-c46a-4f51-a251-fa87666b40f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:47:52.484649 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5aa2e89f-c46a-4f51-a251-fa87666b40f7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.386969 Sep 14 19:47:52.484649 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 19:47:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:52.492078 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ce3acab9-9a43-4a5b-9269-e3bc6c7ffb50 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.507460 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ce3acab9-9a43-4a5b-9269-e3bc6c7ffb50 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019643 Sep 14 19:47:52.507988 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 19:47:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:47:52.517354 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.531933 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018085 Sep 14 19:47:52.532447 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Wed Sep 14 19:47:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:47:52.541473 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-837d7767-2d10-4375-8d2d-39f28f23adf2 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:52.546399 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-837d7767-2d10-4375-8d2d-39f28f23adf2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-837d7767-2d10-4375-8d2d-39f28f23adf2 admin admin] Request method failure captured: Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Accept: application/json Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Accept-Encoding: gzip, deflate Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Connection: keep-alive Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Content-Length: 0 Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Host: 10.222.0.42 Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Openstack-Api-Version: compute 2.92 Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: User-Agent: python-novaclient Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABjIi_n4_cWRLEmilphL6ZzgtGyFurpT8OOi9fDcT5M7kq-4Y8CAp4T20NE0HMhNO6iinccWh3L-MxQEgQ2eqnIl8cPZjbqd98w_CjS4ud1BL7INXJsmLTmbQmbA5cmS61r4eJwPIVs3ubiIjEdak494WkVq7-QNzkQj9e1q9ILgCZ4tD4 Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Project-Name: admin Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Role: member,reader,admin Sep 14 19:47:52.547885 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Roles: member,reader,admin Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8f053b53ae4aff97a668669e77d899", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8f053b53ae4aff97a668669e77d899"}]}] Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant: admin Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 2a8f053b53ae4aff97a668669e77d899 Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-Tenant-Name: admin Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User: admin Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Id: e8f45104d2d540658c4bbc32613a9317 Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: X-User-Name: admin Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: method: > Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: exception: Flavor 451 could not be found. Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: action_args: {'id': '451'} Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:47:52.549643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:52.550651 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Sep 14 19:47:52.551708 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-837d7767-2d10-4375-8d2d-39f28f23adf2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:47:52.553213 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-837d7767-2d10-4375-8d2d-39f28f23adf2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011228 Sep 14 19:47:52.553213 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 19:47:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 19:47:53.761359 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:53.762399 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 14 19:47:53.762815 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:54.281009 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a5aa1087-b4c1-484a-ab87-15c0d6da7412 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:54.360857 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a5aa1087-b4c1-484a-ab87-15c0d6da7412 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.461076 Sep 14 19:47:54.361398 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 19:47:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:55.576923 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:55.577999 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 14 19:47:55.578397 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:56.093791 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-204f79eb-b0af-4ce9-b182-815a3e91964f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:56.172941 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-204f79eb-b0af-4ce9-b182-815a3e91964f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.457644 Sep 14 19:47:56.173423 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 19:47:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:47:57.378583 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:57.379584 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 14 19:47:57.379975 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:57.898134 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-13a884cc-e92e-4413-ae80-00ba4417959f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:57.973033 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-13a884cc-e92e-4413-ae80-00ba4417959f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.456548 Sep 14 19:47:57.973581 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 19:47:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:47:59.179821 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:47:59.180842 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 14 19:47:59.181240 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:47:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:47:59.691796 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-99b0f22d-eca5-4c75-b52a-81ac8ad6c638 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:47:59.778732 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-99b0f22d-eca5-4c75-b52a-81ac8ad6c638 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.460613 Sep 14 19:47:59.779289 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Wed Sep 14 19:47:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:48:00.984856 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:00.985965 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 14 19:48:00.986509 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:48:01.499296 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f9cefc87-6016-40c7-b68f-b74c46a6f254 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:48:01.519212 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f9cefc87-6016-40c7-b68f-b74c46a6f254 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395109 Sep 14 19:48:01.519743 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Wed Sep 14 19:48:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:49:02.618388 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:02.619410 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f92f24eb-d518-4cca-a2ea-7c5ab499e400 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 14 19:49:02.619804 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Wed Sep 14 19:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:49:02.627000 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:03.001269 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6f13788d-ea7f-4db6-9fd3-4b4cffa2d0ad admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.021849 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6f13788d-ea7f-4db6-9fd3-4b4cffa2d0ad admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.396222 Sep 14 19:49:03.022379 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Wed Sep 14 19:49:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:49:03.043612 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=14 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:49:03.047260 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b78c4d5c-7451-4585-aaa1-807f48e75104 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.054326 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b78c4d5c-7451-4585-aaa1-807f48e75104 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012252 Sep 14 19:49:03.054869 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Sep 14 19:49:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:03.066643 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9502b44a-2247-40a2-8732-c0b3f3a1eb21 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.073776 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9502b44a-2247-40a2-8732-c0b3f3a1eb21 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010996 Sep 14 19:49:03.074315 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Sep 14 19:49:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:03.086057 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.093327 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010815 Sep 14 19:49:03.093861 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Wed Sep 14 19:49:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:49:03.105343 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-087049b0-a2bc-4ac4-b759-2fbfc2a3f7b2 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:49:03.112307 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-087049b0-a2bc-4ac4-b759-2fbfc2a3f7b2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010303 Sep 14 19:49:03.112793 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Wed Sep 14 19:49:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:53:36.510832 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:36.511909 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 14 19:53:36.512370 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:53:36.655662 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:53:36.797000 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:36.801666 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:36.802175 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:36.802596 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:36.803301 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:36.803739 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:36.804177 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:36.834969 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a8d6dd8d-8c23-41b2-9e73-e90e4599dada admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.180625 Sep 14 19:53:36.835507 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 19:53:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:53:37.908848 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:37.909888 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 14 19:53:37.910287 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:53:38.102327 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:38.106310 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:38.106813 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:38.107234 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:38.107936 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:38.108378 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:38.108783 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:38.127624 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a871293f-d9ad-40ee-af57-4f1bc510f85e admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075336 Sep 14 19:53:38.128153 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 19:53:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:53:49.610673 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:49.611672 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 14 19:53:49.612066 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:53:49.755625 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:53:49.756294 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:53:49.756903 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=8 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:53:49.804532 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:49.807866 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:49.808337 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:49.808755 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:49.810122 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:49.810562 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:49.810973 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:49.835875 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fdb712f8-d781-401d-8989-ff983ea32d25 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084869 Sep 14 19:53:49.836449 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 19:53:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:53:50.909230 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:50.910261 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f3a07d9-41ec-4476-92ee-0dd6517e6c99 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 14 19:53:50.910652 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Wed Sep 14 19:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:53:51.104357 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:53:51.108420 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:51.108888 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:51.109306 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:51.110039 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:53:51.110480 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:53:51.110891 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:53:51.132978 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-65d352dc-e284-4879-90c0-05f322e2ec7b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083845 Sep 14 19:53:51.133524 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Wed Sep 14 19:53:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:54:50.604205 dv-cinder-839768-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 14 19:54:50.604740 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: Wed Sep 14 19:54:50 2022 - graceful shutdown triggered... Sep 14 19:54:50.605192 dv-cinder-839768-8-iscsi devstack@n-api.service[117788]: Gracefully killing worker 2 (pid: 117788)... Sep 14 19:54:50.605646 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: Gracefully killing worker 1 (pid: 117787)... Sep 14 19:54:50.731675 dv-cinder-839768-8-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:54:51.605671 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: worker 1 buried after 1 seconds Sep 14 19:54:51.606250 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: worker 2 buried after 1 seconds Sep 14 19:54:51.606250 dv-cinder-839768-8-iscsi devstack@n-api.service[117786]: goodbye to uWSGI. Sep 14 19:54:51.607272 dv-cinder-839768-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 14 19:54:51.607844 dv-cinder-839768-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 14 19:54:51.610742 dv-cinder-839768-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 19:54:51.620656 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 19:54:51 2022] *** Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: nodename: dv-cinder-839768-8-iscsi Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: machine: x86_64 Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: clock source: unix Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: pcre jit disabled Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: detected number of CPU cores: 4 Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: current working directory: / Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: detected binary path: /usr/bin/uwsgi-core Sep 14 19:54:51.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: your processes number limit is 47680 Sep 14 19:54:51.629729 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: your memory page size is 4096 bytes Sep 14 19:54:51.629729 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: detected max file descriptor number: 2048 Sep 14 19:54:51.629729 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: lock engine: pthread robust mutexes Sep 14 19:54:51.629729 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: thunder lock: enabled Sep 14 19:54:51.629729 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 19:54:51.629729 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 19:54:51.663175 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: Python main interpreter initialized at 0x55a1fb1619c0 Sep 14 19:54:51.663175 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: python threads support enabled Sep 14 19:54:51.663175 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: your server socket listen backlog is limited to 100 connections Sep 14 19:54:51.663175 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: your mercy for graceful operations on workers is 90 seconds Sep 14 19:54:51.663546 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 19:54:51.663618 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: *** Operational MODE: preforking *** Sep 14 19:54:51.663872 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: *** uWSGI is running in multiple interpreter mode *** Sep 14 19:54:51.663872 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: spawned uWSGI master process (pid: 132853) Sep 14 19:54:51.664076 dv-cinder-839768-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 14 19:54:51.664650 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: spawned uWSGI worker 1 (pid: 132861, cores: 1) Sep 14 19:54:51.665017 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: spawned uWSGI worker 2 (pid: 132862, cores: 1) Sep 14 19:54:51.665191 dv-cinder-839768-8-iscsi devstack@n-api.service[132853]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 19:54:52.327852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 19:54:52.337528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 19:54:53.484021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:54:53.484021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: from cryptography.utils import int_from_bytes Sep 14 19:54:53.485105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:54:53.485105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: from cryptography.utils import int_from_bytes Sep 14 19:54:53.491173 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:54:53.491173 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: from cryptography.utils import int_from_bytes Sep 14 19:54:53.491620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 19:54:53.491620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: from cryptography.utils import int_from_bytes Sep 14 19:54:55.935902 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:54:55.936447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 19:54:55.936840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:54:55.937212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 19:54:55.937323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:54:55.937404 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 19:54:55.937496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:54:55.937583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 19:54:55.937686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:54:55.937788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 19:54:55.938130 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.938218 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.938294 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.938375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.938574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.938676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.938828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.938937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.939427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.939553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.939636 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.939717 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.939804 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.939886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.942486 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.942602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.942682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.942770 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.943012 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.943175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.943352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.943511 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.943656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-8-iscsi {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.943808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839768-8-iscsi {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.943808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.945314 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.945577 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.945825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.946043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.946275 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.946498 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.946725 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.946933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.947142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.947351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.947581 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.947798 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.948006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.948225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.948467 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.948467 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.950230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.950230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.950693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.950906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.951128 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.951449 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.951672 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.951898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.952106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.952284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.952464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.952662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.952819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.953043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.953194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.953351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.953513 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.953668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.953883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.954042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-8-iscsi {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.954208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839768-8-iscsi {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.954354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.954497 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.954650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.954796 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.954939 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.955096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.955096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.955425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.955581 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.955733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.955885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.956040 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.956205 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.956357 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.956508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.956652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.956805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.956959 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.957111 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.957266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.957410 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.957554 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.957705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.957967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.958131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.958284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.958437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.958582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.958739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.958885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.959045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.959198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.959352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.959503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.959661 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.959806 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.959958 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.960113 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.960258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.960401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.960561 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.960714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.960860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.961012 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.961168 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.961322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.961475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.961625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.961789 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.962036 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.962189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.962349 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.962503 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.962659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.962804 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.962960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.963162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.963315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.963471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.963626 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.963778 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.963923 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.964086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.964231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.964374 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.964531 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.964684 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.964839 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.964993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.965146 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.965291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.965434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.965600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.965754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.968015 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.968778 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.968962 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.969132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.969292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.969446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.969600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.969753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.970005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.970154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.970336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.970485 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.970629 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.970779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.970932 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.971077 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.971231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.971384 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.971536 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.971681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.971834 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.972174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.972330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.972636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.972790 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.973152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.973312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.973465 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.973610 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.973761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.973978 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.974127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.974278 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.974423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.974569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.974721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.974878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.975078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.975227 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.975381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.975526 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.975684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.975840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.976068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.976236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.976383 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.976537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.976701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.976855 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.977018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.977211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.977361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.977517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.977683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.977897 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.978047 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.978217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.978363 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.978521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.978678 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.978832 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.978983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.979135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.979287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.979444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.979589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.979740 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.979893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.980037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.981144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.981144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.981421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.981645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.981792 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.981982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.981982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.982274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.982427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.983226 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.983390 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.983537 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.983680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.983825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.983986 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.984140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.984285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.984438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.984594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.984746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.984898 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.985045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.985239 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.985395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.985549 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.985694 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.985882 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.986043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.986197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.986353 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.986498 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.986498 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.986788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.986933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.987077 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.987230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.987375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.987529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.987674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.987838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.987985 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.988138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.988291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.988453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.988663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.988825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.988983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.989135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.989280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.989432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.989576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.989720 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.989906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.990063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.990216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.990373 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.990536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.990536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.990818 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.990964 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.991114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.991267 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.991420 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.991575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.991719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.991863 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.992006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.992149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.992293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.992461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.992644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.992850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.993006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.993159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 19:54:55.993343 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.993503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.993657 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.993853 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.994005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.994160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.994313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.994479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.994632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.994777 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.994922 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.995077 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.995235 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.995388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.995541 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.995693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.995847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.996001 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.996162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.996322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.996485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.996641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.996786 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.996946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.997100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.997254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.997399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.997399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.997688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.997688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.998011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.998465 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.998615 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.998779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.998932 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.999078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.999228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.999382 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.999527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.999688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:55.999842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.000166 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.000330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.000484 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.000646 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.000803 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.000957 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.001114 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.001274 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.001420 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.001564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.001564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.001874 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.002027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.002189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.002343 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.002497 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.002650 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.002811 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.002966 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.003121 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.003266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.003455 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.003612 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.003758 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.003923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.004070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.004758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.004925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.005097 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.005244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.005388 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.005551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.005705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.005893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.006286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.006452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.006607 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.006754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.006900 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.007056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.007228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.007434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.007591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.007737 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.007896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.008062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.008210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.008355 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.008514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.008668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.008895 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.009044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.009189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.009342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.009505 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.009658 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.009870 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.010023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.010168 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.010314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.010468 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.010614 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.010768 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.010914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.011059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.011210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.011357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.011527 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.011689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.011843 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.011990 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.012142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.012289 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.012448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.012594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.012747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.012892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.013037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.013188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.013356 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.013554 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.013739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.013926 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.014084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.014238 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.014402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.014548 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.014699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.014852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.014997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.015156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.015302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.015466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.015619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.015764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.015916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.016070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.016223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.016377 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.016524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.016667 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.016827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.016986 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.017131 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.017275 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.017429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.017583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.017728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.018115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.018275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.018416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.018560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.018709 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.018860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.019004 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.019152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.019302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.019592 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.019762 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.019919 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.020079 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.020241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.020396 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.020598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.020739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.020895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.021036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.021184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.021326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.021474 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.021625 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.021782 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.021975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.022117 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.022283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.022430 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.022588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.022733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.022875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.022966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.023914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024000 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024245 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024625 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024710 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.024979 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025161 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025253 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025445 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025814 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.025919 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026098 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.026934 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027195 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027382 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027475 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027568 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027661 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027847 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.027945 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028032 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028556 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.028907 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.029001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.029088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.029173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.029257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.029890 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.029994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030082 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030342 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.030947 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031116 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031388 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.031915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032176 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032523 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.032921 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033158 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033852 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.033940 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034651 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.034937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035222 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035413 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035778 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035870 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.035970 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036155 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036325 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036783 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036867 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.036959 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037494 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037579 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037579 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.037952 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038743 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.038920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039012 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039097 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039192 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039284 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039370 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039548 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039813 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.039982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.040159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.040270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.040469 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.040564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.040773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.040868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.041091 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.041196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.041413 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.041527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.041724 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.041841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.042072 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.042211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.042403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.042572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.042730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.042883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.043050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.043321 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.045832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.045949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046277 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046658 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046738 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.046986 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.047828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.048066 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.048176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.048406 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.048515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.048725 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.048817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.049046 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.049147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.049358 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.049459 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.049670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.049777 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.050058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.050252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.050416 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.050573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.050747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.050949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.051116 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.051260 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.051573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.051730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.051875 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.052030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.052182 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.052326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.052474 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.052614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.052771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.052934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.053083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.053229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.053375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.053541 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.053708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.053884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.054041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.054193 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.054356 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.054508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.054670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.054822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.054984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055226 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055321 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055775 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.055878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.056020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.056113 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.056374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.056548 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.056709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.056866 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.057049 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.057225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.057375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.057466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.057567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.057663 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.057905 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.058010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.058187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.058308 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.058515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.058652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.058826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.058954 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.059142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.059243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.059446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.059554 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.059759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.059853 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.060063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.060155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.060366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.060471 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.060692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.060788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.061007 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.061100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.061317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.061421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.061621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.061723 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.062203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.062304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.062514 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.062656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.062825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.062920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.063134 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.063237 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.063438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.063578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.063749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.063894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.064051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.064153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.064367 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.064483 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.064674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.064770 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.065072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.065185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.065356 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.065453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.065577 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.065680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.065907 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.066021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.066214 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.066317 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.066530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.066626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.066832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.066936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.067137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.067231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.067442 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.067540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.067747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.067856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.068052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.068144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.068359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.068451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.068668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.068772 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.068970 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.069073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.069291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.069394 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.069597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.069692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.069919 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.070016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.070226 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.070320 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.070530 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.070632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.070832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.070925 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.071134 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.071235 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.071437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.071531 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.071752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.071858 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.072060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.072156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.072361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.072466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.072666 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.072764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.072969 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.073080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.073272 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.073366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.073574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.073676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.073904 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.074041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.074209 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.074306 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.074511 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.074605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.074812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.074916 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.075135 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.075268 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.075420 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.075524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.075741 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.075851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.076051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.076157 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.076387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.076569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.076724 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.076875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.077030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.077186 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.077336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.077481 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.077635 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.077834 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.077981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.078124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.078265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.078409 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.078574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.078717 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.078869 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.079018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.079183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.079336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.079489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.079638 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.079796 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.079937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.080108 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.080253 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.080436 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.080592 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.080743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.080891 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.081057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.081211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.081359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.081501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.081650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.081792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.081985 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.082138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.082280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.082434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.082585 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.082727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.082900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.083055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.083199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.083346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.083513 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.083658 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.083808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.083969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.084117 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.084256 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.084415 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.084559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.084717 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.084859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.085007 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.085181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.085319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.085457 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.085605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.085749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.086021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.086162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.086312 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.086465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.086624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.086767 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.086909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.087057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.087211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.087353 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.087503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.087646 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.087795 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.087946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.088095 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.088245 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.088398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.088550 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.088703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.088854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.088996 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.089154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.089296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.089438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.089579 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.089718 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.089884 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.090030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.090191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.090338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.090480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.090703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.090848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.091003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.091145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.091326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.091479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.091622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.091771 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.092447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.092593 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.092771 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.092908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.093100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.093252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.093402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.093553 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.093733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.093921 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.094091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.094327 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.094473 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.094571 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.094681 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.094785 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.094991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.095106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.095315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.095408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.095629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.095725 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.095956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.096064 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.096263 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.096366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.096570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.096735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.096880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.097053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.097201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.097371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.097506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.097699 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.097899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.098060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.098267 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.098395 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.098582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.098694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.098890 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.099018 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.099308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.099413 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.099625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.099720 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.099939 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.100032 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.100264 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.100358 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.100582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.100683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.100894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.100989 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.101202 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.101304 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.101520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.101623 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.101860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.101983 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.102187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.102297 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.102513 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.102607 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.102825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.102920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.103141 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.103245 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.103448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.103544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.103773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.103915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.104096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.104208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.104411 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.104551 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.104731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.104826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.105045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.105140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.105355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.105460 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.105685 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.105846 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.106022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.106118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.106341 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.106435 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.106656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.106751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.106970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.107066 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.107281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.107375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.108139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.108242 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.108456 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.108551 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.108769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.108871 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.109074 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.109182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.109389 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.109493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.109700 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.109829 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.110034 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.110147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.110342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.110445 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.110645 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.110747 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.110966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.111070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.111270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.111373 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.111578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.111672 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.111890 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.111998 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.112209 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.112303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.112529 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.112624 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.112834 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.112936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.113155 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.113249 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.113464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.113561 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.113769 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.113886 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.114111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.114241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.114416 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.114554 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.114760 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.114859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.115067 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.115170 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.115388 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.115488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.115716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.115861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.116023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.116120 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.116333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.116514 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.116647 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.116750 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.116956 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.117058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.117266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.117380 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.117575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.117670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.117911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.118011 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.118221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.118334 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.118527 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.118621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.118830 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.118925 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.119140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.119249 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.119444 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.119538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.119746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.119841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.120050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.120155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.120358 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.120458 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.120658 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.120752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.120959 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.121054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.121263 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.121371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.121585 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.121680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.121915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.122073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.122238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.122333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.122548 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.122641 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.122851 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.122947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.123177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.123274 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.123481 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.123601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.123821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.123914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.124125 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.124230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.124446 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.124557 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.124756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.124860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.125073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.125167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.125387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.125494 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.125701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.125848 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.126039 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.126136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.126353 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.126579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.126683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.126912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.127015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.127234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.127339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.127553 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.127662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.127866 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.127996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.128180 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.128315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.128499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.128596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.128814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.129031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.129126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.129365 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.129461 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.129686 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.129781 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.130029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.130147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.130345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.130448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.130661 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.130756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.130974 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.131122 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.131289 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.131385 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.131602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.131705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.131914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.132022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.132224 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.132334 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.132551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.132655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.132872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.132970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.133187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.133288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.133506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.133608 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.133851 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.133963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.134159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.134255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.134473 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.134617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.134828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.134940 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.135095 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.135188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.135412 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.135518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.135728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.135831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.136045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.136175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.136362 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.136471 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.136678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.136779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.137007 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.137110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.137313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.137415 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.137626 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.137722 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.137963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.138058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.138274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.138370 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.138583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.138704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.138919 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.139134 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.139241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.139456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.139559 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.139792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.139895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.140122 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.140219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.140450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.140545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.140758 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.140853 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.141074 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.141182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.141402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.141593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.141714 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.141928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.142044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.142260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.142363 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.142625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.142710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.142947 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.143055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.143264 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.143359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.143581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.143676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.143891 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.143985 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.144200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.144301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.144514 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.144657 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.144815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.145049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.145163 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.145402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.145506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.145726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.145933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.146061 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.146194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.146365 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.146468 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.146685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.146792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.147000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.147095 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.147329 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.147535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.147640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.147880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.147975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.148198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.148301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.148522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.148664 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.148836 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.148965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.149145 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.149276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.149450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.149583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.149761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.149935 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.150092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.150213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.150399 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.150537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.150703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.150832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.151011 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.151131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.151313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.151437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.151615 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.151807 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.151925 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.152044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.152219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.152340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.152522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.152643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.152828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.152955 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.153128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.153248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.153436 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.153532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.153745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.153873 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.154073 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.154183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.154927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.155092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.155184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.155297 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.155489 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.155604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.155790 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.155929 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.156093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.156246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.156388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.156558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.156696 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.156888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.156993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.157199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.157389 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.157507 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.157696 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.157849 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.158031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.158167 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.158389 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.158491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.158700 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.158795 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.159005 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.159102 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.159328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.159422 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.159632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.159750 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.159935 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.160251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.160352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.160559 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.160664 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.160880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.160988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.161194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.161289 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.161505 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.161601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.161868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.161981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.162190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.162286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.162496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.162730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.162840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.163062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.163164 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.163382 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.163485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.163710 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.163850 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.164036 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.164140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.164343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.164446 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.164648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.164753 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.165039 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.165188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.165285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.165372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.165564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.165694 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.165898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.166021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.166208 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.166312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.166520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.166622 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.166828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.166939 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.167137 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.167255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.167455 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.167628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.167777 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.167874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.168057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.168209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.168352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.168486 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.168659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.168805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.168968 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.169100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.169276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.169374 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.169583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.169678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.169927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.170090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.170298 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.170430 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.170620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.170749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.170956 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.171067 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.171280 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.171377 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.171595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.171690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.171966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.172074 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.172276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.172378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.172583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.172687 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.172891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.172994 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.173206 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.173301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.173535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.173629 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.173910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.174058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.174205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.174347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.174530 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.174637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.174847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.174942 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.175184 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.175336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.175501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.175694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.175815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.175911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.176136 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.176231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.176458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.176733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.176836 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.176930 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.177066 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.177161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.177379 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.177527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.177699 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.177819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.178040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.178149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.178351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.178455 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.178659 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.178762 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.178974 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.179069 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.179278 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.179383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.179582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.179684 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.179887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.179998 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.180196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.180298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.180504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.180604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.180807 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.180915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.181109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.181203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.181413 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.181518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.181712 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.181874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.182039 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.182146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.182344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.182439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.182646 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.182750 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.182952 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.183054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.183254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.183350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.183557 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.183661 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.183859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.183970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.184162 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.184270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.184461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.184565 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.184762 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.184856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.185067 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.185219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.185370 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.185514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.186319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.186432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.186581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.186702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.186886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.187238 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.187450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.187559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.187777 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.187885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.188096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.188191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.188407 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.188539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.188728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.188833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.189040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.189142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.189356 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.189457 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.189665 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.189775 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.190003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.190110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.190318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.190414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.190628 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.190730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.190937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.191040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.191267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.191370 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.191575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.191678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.191886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.192017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.192198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.192294 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.192663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.192785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.192875 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.192970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.193111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.193207 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.193435 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.193540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.193755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.193872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.194083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.194206 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.194402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.194507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.194715 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.194820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.195030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.195135 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.195342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.195444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.195652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.195762 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.195967 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.196075 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.196273 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.196410 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.196583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.196682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.196893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.196989 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.197684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.197841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.197938 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198419 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198505 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198722 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.198819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.199035 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.199139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.199359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.199463 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.199682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.199776 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.199990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.200086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.200311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.200424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.200600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:54:56.200702 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.200966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.201361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.201707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.202060 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.202378 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.202689 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.202993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 19:54:56.203236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 19:54:56.262677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO dbcounter [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Registered counter for database nova_api Sep 14 19:54:56.265152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO dbcounter [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Registered counter for database nova_api Sep 14 19:54:56.283586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_db.sqlalchemy.engines [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.285081 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_db.sqlalchemy.engines [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.291954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writer thread running {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.292336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writer thread running {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.349213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.context [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0995e957-b33c-4c22-b06d-cfa91799dd59(cell1) {{(pid=132861) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:54:56.349426 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.context [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0995e957-b33c-4c22-b06d-cfa91799dd59(cell1) {{(pid=132862) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 19:54:56.353235 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:54:56.353354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:54:56.353712 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:54:56.353851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:54:56.355292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:54:56.355411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:54:56.356016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:54:56.356127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:54:56.356476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:54:56.356608 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:54:56.358991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:54:56.359102 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:54:56.360977 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO dbcounter [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Registered counter for database nova_cell0 Sep 14 19:54:56.361083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO dbcounter [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Registered counter for database nova_cell0 Sep 14 19:54:56.364997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO dbcounter [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Registered counter for database nova_cell1 Sep 14 19:54:56.365123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO dbcounter [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Registered counter for database nova_cell1 Sep 14 19:54:56.372154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_db.sqlalchemy.engines [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.374506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_db.sqlalchemy.engines [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.376441 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_db.sqlalchemy.engines [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.377644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writer thread running {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.378544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_db.sqlalchemy.engines [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.383190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writer thread running {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.385773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writer thread running {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.522107 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writer thread running {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.530892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO dbcounter [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Registered counter for database nova_cell0 Sep 14 19:54:56.532104 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO dbcounter [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Registered counter for database nova_cell0 Sep 14 19:54:56.542286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_db.sqlalchemy.engines [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.544184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_db.sqlalchemy.engines [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 19:54:56.547915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writer thread running {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.549292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writer thread running {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 19:54:56.867761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: WARNING keystonemiddleware.auth_token [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:54:56.869398 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: WARNING keystonemiddleware.auth_token [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:54:56.874799 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: WARNING keystonemiddleware.auth_token [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:54:56.876856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: WARNING keystonemiddleware.auth_token [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:54:57.222936 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: WARNING keystonemiddleware.auth_token [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:54:57.223637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: WARNING keystonemiddleware.auth_token [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 19:54:57.229027 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: WARNING keystonemiddleware.auth_token [None req-125685a4-ba1e-4cbd-bbba-6c9b610726eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:54:57.229518 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: WARNING keystonemiddleware.auth_token [None req-2ec77d1d-53ef-45a7-b63b-81c5c5341000 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 19:54:57.235191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1fb1619c0 pid: 132861 (default app) Sep 14 19:54:57.235567 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1fb1619c0 pid: 132862 (default app) Sep 14 19:55:34.506317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:34.507442 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:34.508368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:34.509361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:35.723847 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c501ecfa-34e8-4f76-a3d4-9bd40e7187de tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Action: 'create', calling method: .version_select at 0x7f19e6697430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-715231431"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:38.353785 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c501ecfa-34e8-4f76-a3d4-9bd40e7187de tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.866608 Sep 14 19:55:38.355117 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Wed Sep 14 19:55:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3870 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 19:55:38.372629 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:38.373547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:38.374749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:38.376005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:38.621813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e79c4e10-3d96-467a-b203-4fa8d2c5b297 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e656a310>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:38.902448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e79c4e10-3d96-467a-b203-4fa8d2c5b297 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d780bc5e-bc0e-4e87-8dd1-ab0de6cbecfc" status: 200 len: 350 microversion: 2.1 time: 0.285275 Sep 14 19:55:38.911573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:55:38 2022] GET /compute/v2.1/os-volumes/d780bc5e-bc0e-4e87-8dd1-ab0de6cbecfc => generated 350 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:55:38.971425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-72ce417c-148d-4ad1-9ebb-2cd6bb5c04a2 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e66ef040>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:39.477372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-72ce417c-148d-4ad1-9ebb-2cd6bb5c04a2 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02" status: 200 len: 345 microversion: 2.1 time: 1.110450 Sep 14 19:55:39.479132 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:55:38 2022] GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 => generated 345 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:39.498431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-96c9e0fb-9424-4fa2-bed7-32cad3b142d0 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Action: 'create', calling method: .version_select at 0x7f19e656a9d0>, body: {"snapshot": {"volume_id": "b243093d-5041-462a-85a4-657b4b50ea02", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-771562885"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:40.907645 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-96c9e0fb-9424-4fa2-bed7-32cad3b142d0 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.417669 Sep 14 19:55:40.908525 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 3/4] 10.222.0.42 () {60 vars in 1162 bytes} [Wed Sep 14 19:55:39 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:40.932857 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f448e38b-7002-4060-b513-5ac5ad9a84d9 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e655b430>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:41.163755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f448e38b-7002-4060-b513-5ac5ad9a84d9 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 200 len: 286 microversion: 2.1 time: 0.248399 Sep 14 19:55:41.164541 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 2/5] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 19:55:40 2022] GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 286 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:41.177951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ea54e653-5a1a-438a-8c18-95e5ca508c03 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e6502b80>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:41.283604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-71dfea5d-2025-43ef-886a-a19942ffbe05 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e655ba60>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:41.544902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ea54e653-5a1a-438a-8c18-95e5ca508c03 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.372615 Sep 14 19:55:41.546395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 4/6] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Sep 14 19:55:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:41.558156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d9ed9f71-1bbd-4949-9afe-83f44cdcdb67 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e6697dc0>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:41.628388 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-71dfea5d-2025-43ef-886a-a19942ffbe05 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e37114dc-d47f-4baa-a6bb-485ffa7fc499" status: 200 len: 350 microversion: 2.1 time: 0.350058 Sep 14 19:55:41.629504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:55:41 2022] GET /compute/v2.1/os-volumes/e37114dc-d47f-4baa-a6bb-485ffa7fc499 => generated 350 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:41.994784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d9ed9f71-1bbd-4949-9afe-83f44cdcdb67 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 200 len: 286 microversion: 2.1 time: 0.430401 Sep 14 19:55:41.994784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 19:55:41 2022] GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 286 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:43.000830 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-656d3186-dded-4a6e-9460-31945573f53c tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e655bd30>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:43.055318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-656d3186-dded-4a6e-9460-31945573f53c tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 200 len: 286 microversion: 2.1 time: 0.058591 Sep 14 19:55:43.060793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 4/9] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 19:55:42 2022] GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:44.069112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e1df516b-6951-4748-bf76-ab39b063c5a0 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e656a940>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:44.118796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e1df516b-6951-4748-bf76-ab39b063c5a0 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 200 len: 286 microversion: 2.1 time: 0.046835 Sep 14 19:55:44.118796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 19:55:44 2022] GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:45.083491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2fbfc372-b5b9-4cce-9e0c-c8b08fd88d90 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e655b670>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:45.123916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-681b7bda-08cd-4050-b740-5415948876ec tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e656a1f0>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:45.206755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2fbfc372-b5b9-4cce-9e0c-c8b08fd88d90 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d0c4845f-2655-4142-a7c4-e2ff88ba56e1" status: 200 len: 351 microversion: 2.1 time: 0.129115 Sep 14 19:55:45.216903 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 5/11] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:55:45 2022] GET /compute/v2.1/os-volumes/d0c4845f-2655-4142-a7c4-e2ff88ba56e1 => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:45.222563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-519f507e-288f-45c9-9ced-1ea530a41f37 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e656f1f0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:45.267387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-681b7bda-08cd-4050-b740-5415948876ec tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 200 len: 287 microversion: 2.1 time: 0.147244 Sep 14 19:55:45.268413 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 19:55:45 2022] GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:45.288664 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d7d70a9f-0d65-49af-997d-c270a5c14986 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e656a940>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:45.444206 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-519f507e-288f-45c9-9ced-1ea530a41f37 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.225453 Sep 14 19:55:45.444881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Sep 14 19:55:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:45.460831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6c77db9d-c37a-4790-9482-cbd19a0efa4b tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e655b550>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:45.637244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d7d70a9f-0d65-49af-997d-c270a5c14986 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 202 len: 0 microversion: 2.1 time: 0.358818 Sep 14 19:55:45.637244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Sep 14 19:55:45 2022] DELETE /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:55:45.645859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-14f87e47-5586-44e8-9db7-ead3a769a7c7 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e6ec4790>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:45.821770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6c77db9d-c37a-4790-9482-cbd19a0efa4b tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.364959 Sep 14 19:55:45.822765 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1149 bytes} [Wed Sep 14 19:55:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:55:45.848092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bae4cf29-bbae-4b8d-a883-619e6523ccd3 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e656d790>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:45.907064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-14f87e47-5586-44e8-9db7-ead3a769a7c7 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 200 len: 286 microversion: 2.1 time: 0.266166 Sep 14 19:55:45.907881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 19:55:45 2022] GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 286 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:46.141729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bae4cf29-bbae-4b8d-a883-619e6523ccd3 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.302490 Sep 14 19:55:46.143063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1134 bytes} [Wed Sep 14 19:55:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:46.159079 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bf215ce7-bb07-418d-8e37-128fffe01f26 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e6502430>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:46.359110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bf215ce7-bb07-418d-8e37-128fffe01f26 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.205332 Sep 14 19:55:46.359248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1167 bytes} [Wed Sep 14 19:55:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:46.391891 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-22defc79-9b20-4b85-86a8-0fe6873df2bf tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e6ec4790>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:46.530762 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-22defc79-9b20-4b85-86a8-0fe6873df2bf tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.159138 Sep 14 19:55:46.535713 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 9/19] 10.222.0.42 () {58 vars in 1170 bytes} [Wed Sep 14 19:55:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:46.552011 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cbf684f3-22d4-48b3-ae93-ef3595690b96 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e6502f70>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:46.743671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cbf684f3-22d4-48b3-ae93-ef3595690b96 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.195671 Sep 14 19:55:46.744868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 11/20] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Sep 14 19:55:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:46.761094 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-93c984fd-281a-4bfa-9099-f11a4b53ef7d tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e6504430>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:47.052899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1249462338", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:47.205058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-93c984fd-281a-4bfa-9099-f11a4b53ef7d tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.450338 Sep 14 19:55:47.210635 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 10/21] 10.222.0.42 () {58 vars in 1188 bytes} [Wed Sep 14 19:55:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:47.211267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-60df242b-b82e-4b3a-b871-0872b2894a7b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e650c820>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:47.269773 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-60df242b-b82e-4b3a-b871-0872b2894a7b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] HTTP exception thrown: Snapshot 6098d6c5-9111-4392-a484-3a0cf9f1771e could not be found. Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-60df242b-b82e-4b3a-b871-0872b2894a7b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Request method failure captured: Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e HTTP/1.1 Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjG2_5u2CoWUTkpf1Utt0pzCyl6V3lakb6RjnhV8TgNk7Kaf2RvW48dBay6cLFCZDd1H-ltzVY8NUvZM45A1sL4F34pNnZ8WsYgJmB31hJnt1zASg2dPZW1B7akepbEtc7zuItgob8506YtoXTDSLaWxMkFWgh2wbmo-U6BvcAN_3ao Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:55:47.278875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98ab5a8a92a04992a4ad32e96f32306c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}] Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 01d6926769014a88bbfd4be361b2a307 Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Snapshot 6098d6c5-9111-4392-a484-3a0cf9f1771e could not be found. Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '6098d6c5-9111-4392-a484-3a0cf9f1771e'} Sep 14 19:55:47.280129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6098d6c5-9111-4392-a484-3a0cf9f1771e could not be found. (HTTP 404) (Request-ID: req-33d836a8-d195-40dd-9479-82b070178e59) Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:47.281248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:55:47.283140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6098d6c5-9111-4392-a484-3a0cf9f1771e could not be found. Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 14 19:55:47.284333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6098d6c5-9111-4392-a484-3a0cf9f1771e could not be found. Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6098d6c5-9111-4392-a484-3a0cf9f1771e could not be found. Sep 14 19:55:47.285572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:47.288028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-60df242b-b82e-4b3a-b871-0872b2894a7b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Returning 404 to user: Snapshot 6098d6c5-9111-4392-a484-3a0cf9f1771e could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:55:47.289123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-60df242b-b82e-4b3a-b871-0872b2894a7b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e" status: 404 len: 111 microversion: 2.1 time: 0.081882 Sep 14 19:55:47.289854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 11/22] 10.222.0.42 () {58 vars in 1251 bytes} [Wed Sep 14 19:55:47 2022] GET /compute/v2.1/os-snapshots/6098d6c5-9111-4392-a484-3a0cf9f1771e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:55:47.309584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c0eb8014-56a6-4d33-a9bb-627944328f57 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] Calling method '.version_select at 0x7f19e656d1f0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:47.428106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] validate_networks() for [('ebf7e7ae-b3ea-433e-935a-edccba421b3a', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:55:47.486438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c0eb8014-56a6-4d33-a9bb-627944328f57 tempest-VolumesTestJSON-1885151108 tempest-VolumesTestJSON-1885151108-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.194923 Sep 14 19:55:47.487358 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1155 bytes} [Wed Sep 14 19:55:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:47.492255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-013cdc5e-15bd-496f-9bdd-eb0b1c625fef tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e656dca0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:47.867842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-013cdc5e-15bd-496f-9bdd-eb0b1c625fef tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02" status: 202 len: 0 microversion: 2.1 time: 0.379169 Sep 14 19:55:47.869001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 19:55:47 2022] DELETE /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:55:48.390663 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1596036326", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "networks": [{"uuid": "dbdf11bd-9fd2-463d-91c2-c7d79c055a05"}]}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:48.607383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] validate_networks() for [('dbdf11bd-9fd2-463d-91c2-c7d79c055a05', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:55:49.649142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:55:49.649709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:55:49.650251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:55:49.650778 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:55:49.651428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:55:49.693934 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:49.694651 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:49.695558 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:49.699361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:49.700361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:49.700361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:49.834678 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:55:49.865020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for user 766dd5a650fc4855980250969854f08d and project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:55:49.881716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:55:49.883557 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:55:49.884092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:55:49.884809 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:55:49.885535 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:55:49.916284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:55:49.929997 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:49.930817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:49.931411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:49.931622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:55:49.933290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:49.934944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:49.935677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:50.035361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Getting quotas for project b04e9cb110f049d69a2d2747c74c8b51. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:55:50.055882 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Getting quotas for user 96428b8e76314536a9e7033a841454e2 and project b04e9cb110f049d69a2d2747c74c8b51. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:55:50.082331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:55:50.089762 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:55:50.274207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-52a50a94-d937-4a51-9695-f25759ab636b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.381028 Sep 14 19:55:50.277736 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 12/25] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:55:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 19:55:50.298932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2cd1e44e-9d6b-45e3-81ca-66965308894b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e5c1d5e0>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:50.343225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5ff017e3-f534-476f-a411-e98e613cd581 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.469365 Sep 14 19:55:50.345085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 14/26] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:55:50.622207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-2cd1e44e-9d6b-45e3-81ca-66965308894b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] HTTP exception thrown: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2cd1e44e-9d6b-45e3-81ca-66965308894b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Request method failure captured: Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 HTTP/1.1 Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjG2_5u2CoWUTkpf1Utt0pzCyl6V3lakb6RjnhV8TgNk7Kaf2RvW48dBay6cLFCZDd1H-ltzVY8NUvZM45A1sL4F34pNnZ8WsYgJmB31hJnt1zASg2dPZW1B7akepbEtc7zuItgob8506YtoXTDSLaWxMkFWgh2wbmo-U6BvcAN_3ao Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 19:55:50.628670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98ab5a8a92a04992a4ad32e96f32306c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}] Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 01d6926769014a88bbfd4be361b2a307 Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'b243093d-5041-462a-85a4-657b4b50ea02'} Sep 14 19:55:50.630085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. (HTTP 404) (Request-ID: req-9a2a26f2-936a-428e-9795-bd266a5fd707) Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:50.630732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:55:50.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 19:55:50.637086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2cd1e44e-9d6b-45e3-81ca-66965308894b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Returning 404 to user: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2cd1e44e-9d6b-45e3-81ca-66965308894b tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02" status: 404 len: 109 microversion: 2.1 time: 0.351449 Sep 14 19:55:50.638175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:55:50 2022] GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 => generated 109 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:55:50.645528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-00b752e9-4a94-4d1c-9030-c550a3b81619 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:50.646305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-00b752e9-4a94-4d1c-9030-c550a3b81619 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:50.848018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-00b752e9-4a94-4d1c-9030-c550a3b81619 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:50.915743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-00b752e9-4a94-4d1c-9030-c550a3b81619 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1222 microversion: 2.1 time: 0.281251 Sep 14 19:55:50.930658 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:50 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1222 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:50.935838 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-da2db8ce-29a8-4d58-b3d3-813f033807d3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:50.936454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-da2db8ce-29a8-4d58-b3d3-813f033807d3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:50.966293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d75a9199-46fe-4e50-9237-d100e0ef3e6c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'create', calling method: .version_select at 0x7f19e5bdf670>, body: {"keypair": {"name": "tempest-keypair-205498365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWeShjwBSmGFskATKIK8pJ2EtY6usE+utzqJbYfdJ/J04RosswqLz7EKIsRdeeh3mi7/gbI6DyAh2nxwHN4m4u9ur9zXsZEbYXWrR3xXqpBveYSoRNf77mPOwmkltslXQ=="}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:51.018217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-d75a9199-46fe-4e50-9237-d100e0ef3e6c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for project bdb5ca35665545119e4ca1f379c37a73. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:55:51.028940 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-d75a9199-46fe-4e50-9237-d100e0ef3e6c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for user 2bf1c7a6cc2e4b1294e7b162a8aba738 and project bdb5ca35665545119e4ca1f379c37a73. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:55:51.083091 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-da2db8ce-29a8-4d58-b3d3-813f033807d3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:51.094143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-da2db8ce-29a8-4d58-b3d3-813f033807d3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1215 microversion: 2.1 time: 0.162064 Sep 14 19:55:51.096170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 15/29] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:50 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:51.181431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d75a9199-46fe-4e50-9237-d100e0ef3e6c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.822426 Sep 14 19:55:51.192417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 15/30] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Sep 14 19:55:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 825 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 19:55:51.192417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1db9e93f-d282-4ec6-a925-eac7f63fb4ea tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e5bf4430>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:51.272208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-1db9e93f-d282-4ec6-a925-eac7f63fb4ea tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] HTTP exception thrown: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1db9e93f-d282-4ec6-a925-eac7f63fb4ea tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Request method failure captured: Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 HTTP/1.1 Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjG2_5u2CoWUTkpf1Utt0pzCyl6V3lakb6RjnhV8TgNk7Kaf2RvW48dBay6cLFCZDd1H-ltzVY8NUvZM45A1sL4F34pNnZ8WsYgJmB31hJnt1zASg2dPZW1B7akepbEtc7zuItgob8506YtoXTDSLaWxMkFWgh2wbmo-U6BvcAN_3ao Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:55:51.275759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98ab5a8a92a04992a4ad32e96f32306c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}] Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 01d6926769014a88bbfd4be361b2a307 Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'b243093d-5041-462a-85a4-657b4b50ea02'} Sep 14 19:55:51.279185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. (HTTP 404) (Request-ID: req-2d58bf89-74d4-4423-8228-dc28e1bac04b) Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:51.280409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 19:55:51.281502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 19:55:51.285545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1db9e93f-d282-4ec6-a925-eac7f63fb4ea tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Returning 404 to user: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1db9e93f-d282-4ec6-a925-eac7f63fb4ea tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02" status: 404 len: 109 microversion: 2.1 time: 0.097967 Sep 14 19:55:51.288255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 16/31] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 19:55:51 2022] DELETE /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:55:51.311381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-21cc5c36-755b-4df4-8c23-af3c19c07732 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Calling method '.version_select at 0x7f19e5b86670>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:51.386086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-21cc5c36-755b-4df4-8c23-af3c19c07732 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] HTTP exception thrown: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-21cc5c36-755b-4df4-8c23-af3c19c07732 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Request method failure captured: Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 HTTP/1.1 Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjG2_5u2CoWUTkpf1Utt0pzCyl6V3lakb6RjnhV8TgNk7Kaf2RvW48dBay6cLFCZDd1H-ltzVY8NUvZM45A1sL4F34pNnZ8WsYgJmB31hJnt1zASg2dPZW1B7akepbEtc7zuItgob8506YtoXTDSLaWxMkFWgh2wbmo-U6BvcAN_3ao Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:55:51.389974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_98ab5a8a92a04992a4ad32e96f32306c", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/98ab5a8a92a04992a4ad32e96f32306c"}]}] Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 98ab5a8a92a04992a4ad32e96f32306c Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-584562441 Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 01d6926769014a88bbfd4be361b2a307 Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesSnapshotsTestJSON-584562441-project Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'b243093d-5041-462a-85a4-657b4b50ea02'} Sep 14 19:55:51.391153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. (HTTP 404) (Request-ID: req-8f5bda82-ba52-471e-b07f-c2a22786da5c) Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:51.391825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:55:51.392991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 19:55:51.395566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. Sep 14 19:55:51.397896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:55:51.405241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-21cc5c36-755b-4df4-8c23-af3c19c07732 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] Returning 404 to user: Volume b243093d-5041-462a-85a4-657b4b50ea02 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:55:51.408169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-21cc5c36-755b-4df4-8c23-af3c19c07732 tempest-VolumesSnapshotsTestJSON-584562441 tempest-VolumesSnapshotsTestJSON-584562441-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02" status: 404 len: 109 microversion: 2.1 time: 0.118417 Sep 14 19:55:51.414023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 17/32] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:55:51 2022] GET /compute/v2.1/os-volumes/b243093d-5041-462a-85a4-657b4b50ea02 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:55:51.446428 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-883257063", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:51.606765 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] validate_networks() for [('ebf7e7ae-b3ea-433e-935a-edccba421b3a', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:55:52.077433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5c219997-6041-41ed-9bc6-8165a77d6cba tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'create', calling method: .version_select at 0x7f19e5ba0af0>, body: {"keypair": {"name": "tempest-keypair-420043711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO6Jb2fALcdcaTVgDbcwZhAaFPptpem44+fWWYH8bOE+J5KSPnbeqM+PR9QDPL6tmuuVo/J8+xmB3/RMqERHA2j8ZrlEEoxJM7xi7lwqAdYzxKV8DdajzjSk4cWxmQmgg=="}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:52.200708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-5c219997-6041-41ed-9bc6-8165a77d6cba tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:55:52.221329 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-5c219997-6041-41ed-9bc6-8165a77d6cba tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for user 268dbf54f29c40d9a4daa772c44735d4 and project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:55:52.444705 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5c219997-6041-41ed-9bc6-8165a77d6cba tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.347077 Sep 14 19:55:52.445757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 16/33] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 19:55:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:55:52.463894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-90eebf0b-288d-40f9-92f1-68e6b61f2758 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:52.464753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-90eebf0b-288d-40f9-92f1-68e6b61f2758 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:53.019023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-90eebf0b-288d-40f9-92f1-68e6b61f2758 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:53.027719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-90eebf0b-288d-40f9-92f1-68e6b61f2758 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1215 microversion: 2.1 time: 0.570565 Sep 14 19:55:53.028295 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 17/34] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:52 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1215 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:53.833496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:55:53.835838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:55:53.837251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:55:53.838033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:55:53.839594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:55:53.851125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:53.852017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:53.852844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:53.854036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:53.855521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:53.856213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:53.907419 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:55:53.913493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for user 766dd5a650fc4855980250969854f08d and project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:55:53.954313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:55:53.962854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:55:54.055323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8e26d892-d755-4933-b057-200a38306a57 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:54.056186 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8e26d892-d755-4933-b057-200a38306a57 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:54.188805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-07f95aec-9655-4f64-82d8-cd036553fc1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.772022 Sep 14 19:55:54.190285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 18/35] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:55:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:55:54.211243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-309c26de-ea74-4d5b-abc8-8f8b3e4098c5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:54.217626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-309c26de-ea74-4d5b-abc8-8f8b3e4098c5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:54.353328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8e26d892-d755-4933-b057-200a38306a57 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:54.365257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8e26d892-d755-4933-b057-200a38306a57 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1215 microversion: 2.1 time: 0.314268 Sep 14 19:55:54.366577 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 18/36] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:54 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:55:54.649094 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-309c26de-ea74-4d5b-abc8-8f8b3e4098c5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:54.699144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-309c26de-ea74-4d5b-abc8-8f8b3e4098c5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1221 microversion: 2.1 time: 0.493654 Sep 14 19:55:54.700920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 19/37] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:54 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1221 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:55.393190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:55.393824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:55.420655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:55.429555 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:55.432465 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:55.435939 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:55.438990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:55.441045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:55.727218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b6e15308-6a0c-47fc-b128-36b72a12ceeb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:55.727944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b6e15308-6a0c-47fc-b128-36b72a12ceeb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:55.816747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:55.842868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7489a51c-3dd5-4db1-ab75-cdb37c2eff9f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1211 microversion: 2.1 time: 0.454661 Sep 14 19:55:55.843702 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 19/38] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:55 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1211 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:56.062109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b6e15308-6a0c-47fc-b128-36b72a12ceeb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:56.076735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b6e15308-6a0c-47fc-b128-36b72a12ceeb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1221 microversion: 2.1 time: 0.355085 Sep 14 19:55:56.077333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 20/39] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:55 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1221 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:56.868613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:56.869229 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:56.885759 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:56.886456 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:56.886920 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:56.891617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:56.891617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:56.891617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:57.077786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:57.086696 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9bc634ca-f11b-4ea6-8e8a-bd5197923d47 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1267 microversion: 2.1 time: 0.221895 Sep 14 19:55:57.096951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:56 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:57.114264 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:57.121301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:57.137674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:57.144470 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:57.148455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:57.149487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:57.152398 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:57.152952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:57.411799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:55:57.424831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-078996f7-6cf0-4dc9-8292-1ff520b10873 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1217 microversion: 2.1 time: 0.315757 Sep 14 19:55:57.425000 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:57 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:55:58.017677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1208509657", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da63156a-ae6e-4671-a212-8f0bbf27ce1b"}], "security_groups": [{"name": "tempest-securitygroup--397284285"}], "key_name": "tempest-keypair-205498365", "user_data": "}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:58.435769 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e41ee10f-46c4-4d1b-a44b-e8ce3351dbb9 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Action: 'create', calling method: .version_select at 0x7f19e5a84a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1633191798", "metadata": {"Type": "work"}}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:55:58.438679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] validate_networks() for [('da63156a-ae6e-4671-a212-8f0bbf27ce1b', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:55:59.655948 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:55:59.657691 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:55:59.658500 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:55:59.659107 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:55:59.659682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:55:59.680477 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:59.681961 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:59.693108 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:59.694082 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:59.698563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:59.701376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:59.742888 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:55:59.754116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for project bdb5ca35665545119e4ca1f379c37a73. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:55:59.761842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for user 2bf1c7a6cc2e4b1294e7b162a8aba738 and project bdb5ca35665545119e4ca1f379c37a73. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:55:59.788398 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:55:59.801715 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:55:59.892465 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e41ee10f-46c4-4d1b-a44b-e8ce3351dbb9 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.053567 Sep 14 19:55:59.893096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 19:55:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2055 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 19:55:59.910971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:55:59.918009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:55:59.954425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:59.956628 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:59.956628 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:55:59.964281 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:55:59.966583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:55:59.968301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:00.147916 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d144450b-9769-46c2-bbae-6fe0d2147bf1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.119182 Sep 14 19:56:00.159042 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 22/43] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Sep 14 19:55:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 19:56:00.195796 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:00.195796 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:00.225563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:00.226641 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:00.227182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:00.227786 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:00.228242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:00.228668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:00.710838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:00.725336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a36827e9-d74e-47ed-942b-d422b9664d97 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1279 microversion: 2.1 time: 0.561570 Sep 14 19:56:00.743721 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:00 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1279 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:00.755842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-468043619", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "655d425e-28f4-45ba-a4d3-323f994e61e4"}], "security_groups": [{"name": "tempest-securitygroup--1213286783"}], "key_name": "tempest-keypair-420043711", "user_data": "}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:00.864037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:00.879679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ae04d98a-748e-451e-91cc-645de0976511 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.976263 Sep 14 19:56:00.880895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 22/45] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:55:59 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:00.887123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ebe4e67f-0de9-4581-b5d3-b539fc90a709 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Calling method '.version_select at 0x7f19e5a84af0>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:00.983662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ebe4e67f-0de9-4581-b5d3-b539fc90a709 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b" status: 200 len: 353 microversion: 2.1 time: 0.101398 Sep 14 19:56:00.984231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 23/46] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:56:00 2022] GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:00.989399 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5d329174-ac50-44e0-abee-2f81980abc3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:00.993333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5d329174-ac50-44e0-abee-2f81980abc3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:01.201153 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5d329174-ac50-44e0-abee-2f81980abc3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:01.211598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5d329174-ac50-44e0-abee-2f81980abc3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:01.213114 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5d329174-ac50-44e0-abee-2f81980abc3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:01.214311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5d329174-ac50-44e0-abee-2f81980abc3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1281 microversion: 2.20 time: 0.228866 Sep 14 19:56:01.215082 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:00 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:01.749823 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:01.750518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:01.764359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:01.764939 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:01.765355 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:01.766907 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:01.767542 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:01.768135 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:01.862688 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] validate_networks() for [('655d425e-28f4-45ba-a4d3-323f994e61e4', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:56:02.572819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:02.584900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8c3a0796-fff6-4948-97c0-ca94ca8ef53b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.838827 Sep 14 19:56:02.590717 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:01 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:02.609537 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:02.613483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:02.625719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:02.630464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:02.630464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:02.647518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:02.648774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:02.650252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:03.264302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:03.278186 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4351a368-02c6-4f20-a70e-92c641f18c56 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.686140 Sep 14 19:56:03.279133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 26/49] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:02 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:03.283998 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-35607396-d4c8-481f-9e4f-bd7e95b567cf tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Calling method '.version_select at 0x7f19e5badd30>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:03.364181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-35607396-d4c8-481f-9e4f-bd7e95b567cf tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b" status: 200 len: 354 microversion: 2.1 time: 0.083804 Sep 14 19:56:03.364966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 27/50] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:56:03 2022] GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:03.380102 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:03.381092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:03.389306 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:03.390495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:03.391531 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:03.392976 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:03.394583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:03.397039 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:03.786549 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:03.795943 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:03.798297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:03.799723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b5d40821-b54c-445f-9cf0-153ddcaaee68 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1277 microversion: 2.20 time: 0.424757 Sep 14 19:56:03.800774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 28/51] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:03 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1277 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:03.926995 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-9cf084a3-6705-446b-be83-f9d042f19ba1 req-b13b9ef4-f8e8-480a-9979-2fd2da7775fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3697671d-a339-45b8-92af-541bad612c17", "tag": "7728d07e-6f92-4423-898e-e72e31a50d1d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:03.975507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9cf084a3-6705-446b-be83-f9d042f19ba1 req-b13b9ef4-f8e8-480a-9979-2fd2da7775fc service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:03.978387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9cf084a3-6705-446b-be83-f9d042f19ba1 req-b13b9ef4-f8e8-480a-9979-2fd2da7775fc service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:03.979395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9cf084a3-6705-446b-be83-f9d042f19ba1 req-b13b9ef4-f8e8-480a-9979-2fd2da7775fc service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.078427 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-9cf084a3-6705-446b-be83-f9d042f19ba1 req-b13b9ef4-f8e8-480a-9979-2fd2da7775fc service nova] Creating event network-changed:7728d07e-6f92-4423-898e-e72e31a50d1d for instance 3697671d-a339-45b8-92af-541bad612c17 on hv-cinder-83976 Sep 14 19:56:04.081611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9cf084a3-6705-446b-be83-f9d042f19ba1 req-b13b9ef4-f8e8-480a-9979-2fd2da7775fc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 19:56:04.084735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9cf084a3-6705-446b-be83-f9d042f19ba1 req-b13b9ef4-f8e8-480a-9979-2fd2da7775fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=132861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 19:56:04.084735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.084735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.084735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.103220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.103913 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.104363 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.131439 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.compute.rpcapi [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 19:56:04.133260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] Releasing lock "compute-rpcapi-router" {{(pid=132861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 19:56:04.160506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8c934491-6ee0-476f-8374-b554dccd7db4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358278 Sep 14 19:56:04.161404 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 29/52] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:04.177874 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ea4834bc-a10c-458b-b177-a3f76b104035 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Calling method '.version_select at 0x7f19e5badc10>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:04.293092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ea4834bc-a10c-458b-b177-a3f76b104035 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b" status: 200 len: 354 microversion: 2.1 time: 0.126173 Sep 14 19:56:04.305468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 30/53] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:56:04 2022] GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:04.314323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:04.317054 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:04.328218 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.329088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.330009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.331038 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.331815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.332617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.387331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:56:04.387879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:56:04.388353 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:56:04.388736 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:56:04.389153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:56:04.412475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.414452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.415176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.418563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.419259 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.420015 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.496840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:56:04.553885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for user 268dbf54f29c40d9a4daa772c44735d4 and project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:56:04.553885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:56:04.553885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:56:04.651527 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:04.660411 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-59334d64-f8fe-4409-9734-7fa6f3b651fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.353224 Sep 14 19:56:04.661074 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 31/54] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:04 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:04.667170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:04.667791 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:04.674776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.675302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.675727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.676410 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:04.676870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:04.677277 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:04.827700 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:04.839609 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-aef80cbc-c167-4180-a90f-0ce9e16df55e tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.177542 Sep 14 19:56:04.863561 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 32/55] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:04 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:04.871802 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-191a53a5-1772-4f36-b510-547ca4434801 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Calling method '.version_select at 0x7f19e5a9c160>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:05.254112 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2708b66f-cda7-4dfd-b16c-4628bd68d230 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.505534 Sep 14 19:56:05.256587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 24/56] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:56:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 4512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:56:05.270035 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:05.275211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:05.288489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:05.292030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:05.292503 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:05.295512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:05.296008 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:05.296453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:05.356652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-191a53a5-1772-4f36-b510-547ca4434801 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b" status: 202 len: 0 microversion: 2.1 time: 0.490667 Sep 14 19:56:05.358612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 33/57] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 19:56:04 2022] DELETE /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:56:05.366637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-195de7f3-859a-4f7a-bd46-28e6963696b0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:05.372300 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-195de7f3-859a-4f7a-bd46-28e6963696b0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:05.731953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:05.745189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:05.746973 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:05.747893 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-83aae34b-a885-4d9f-9cc3-7ca907f9b62e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1333 microversion: 2.20 time: 0.490143 Sep 14 19:56:05.754146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 25/58] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:05 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1333 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:05.762285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-843bedf0-7175-4e25-b859-efc4c31b7443 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Calling method '.version_select at 0x7f19e5aeb820>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:05.869369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-843bedf0-7175-4e25-b859-efc4c31b7443 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] HTTP exception thrown: Volume 45a82a2a-77e7-4341-9a17-26c3971bc62b could not be found. Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-843bedf0-7175-4e25-b859-efc4c31b7443 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Request method failure captured: Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b HTTP/1.1 Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHNtkZA0Jwaz1SnTW7KTSEyjZBsHCPUKQgSWDi2a1L0uk_G_jBTskJYAJy09Ii2rrYj-fYo39OVa83hnnoBBtCN6Gk5Msl6AnJHdQvc3owAfPyTgrpkLg42GozKXmk24b485gffEHfWj_Rq1FTFyBBVze7G4sta9YEnWeRQ3CiD9OA Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 7bfaa4710edf4953a8301100191078b5 Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesGetTestJSON-1789816052 Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:56:05.871604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7bfaa4710edf4953a8301100191078b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7bfaa4710edf4953a8301100191078b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7bfaa4710edf4953a8301100191078b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7bfaa4710edf4953a8301100191078b5"}]}] Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesGetTestJSON-1789816052 Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 7bfaa4710edf4953a8301100191078b5 Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesGetTestJSON-1789816052 Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesGetTestJSON-1789816052-project Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 4146306a979048bcb9bdfe197a2058c1 Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesGetTestJSON-1789816052-project Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Volume 45a82a2a-77e7-4341-9a17-26c3971bc62b could not be found. Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '45a82a2a-77e7-4341-9a17-26c3971bc62b'} Sep 14 19:56:05.872729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45a82a2a-77e7-4341-9a17-26c3971bc62b could not be found. (HTTP 404) (Request-ID: req-0cafabb6-1d18-4210-9f8f-cb4c3c11fcf1) Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:05.873465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:56:05.874936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45a82a2a-77e7-4341-9a17-26c3971bc62b could not be found. Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 19:56:05.875963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45a82a2a-77e7-4341-9a17-26c3971bc62b could not be found. Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45a82a2a-77e7-4341-9a17-26c3971bc62b could not be found. Sep 14 19:56:05.877546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:05.879823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-843bedf0-7175-4e25-b859-efc4c31b7443 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] Returning 404 to user: Volume 45a82a2a-77e7-4341-9a17-26c3971bc62b could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:56:05.880971 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-843bedf0-7175-4e25-b859-efc4c31b7443 tempest-VolumesGetTestJSON-1789816052 tempest-VolumesGetTestJSON-1789816052-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b" status: 404 len: 109 microversion: 2.1 time: 0.125575 Sep 14 19:56:05.882181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 26/59] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:56:05 2022] GET /compute/v2.1/os-volumes/45a82a2a-77e7-4341-9a17-26c3971bc62b => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:56:05.892412 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:05.894604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:05.940886 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:05.942754 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:05.947329 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:05.948327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:05.950546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:05.952887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:06.212080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-195de7f3-859a-4f7a-bd46-28e6963696b0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:06.226016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-195de7f3-859a-4f7a-bd46-28e6963696b0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1236 microversion: 2.1 time: 0.865992 Sep 14 19:56:06.227189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 34/60] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:05 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1236 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:06.232604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:06.233385 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:06.244459 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:06.245164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:06.246562 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:06.247429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:06.248070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:06.249282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:06.779068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:06.791136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-079b256c-2c10-42ae-bca3-b80a32b7e658 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.907465 Sep 14 19:56:06.794982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 27/61] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:05 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:06.989706 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:07.005144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-90bec6f5-2b61-4936-8d76-b7baf3d8628c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.775141 Sep 14 19:56:07.009335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 35/62] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:06 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:07.024020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:07.026293 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:07.064622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.065225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.065706 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.066520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.068560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.073308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.200835 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-9d6feb59-a93e-4f7a-9c3e-0bb46b157e23 req-668ee5af-96b7-43c2-ae8c-0537d3594a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb97b57-3da3-4808-904f-c0573b681648", "tag": "ab2b0c1b-d779-4157-a89f-cb7977ee37dc"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:07.259424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9d6feb59-a93e-4f7a-9c3e-0bb46b157e23 req-668ee5af-96b7-43c2-ae8c-0537d3594a72 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.260376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9d6feb59-a93e-4f7a-9c3e-0bb46b157e23 req-668ee5af-96b7-43c2-ae8c-0537d3594a72 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.264798 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9d6feb59-a93e-4f7a-9c3e-0bb46b157e23 req-668ee5af-96b7-43c2-ae8c-0537d3594a72 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.328395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:07.342748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:07.343121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-9d6feb59-a93e-4f7a-9c3e-0bb46b157e23 req-668ee5af-96b7-43c2-ae8c-0537d3594a72 service nova] Creating event network-changed:ab2b0c1b-d779-4157-a89f-cb7977ee37dc for instance 6cb97b57-3da3-4808-904f-c0573b681648 on hv-cinder-83976 Sep 14 19:56:07.344819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:07.345577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9d6feb59-a93e-4f7a-9c3e-0bb46b157e23 req-668ee5af-96b7-43c2-ae8c-0537d3594a72 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 19:56:07.346606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9d6feb59-a93e-4f7a-9c3e-0bb46b157e23 req-668ee5af-96b7-43c2-ae8c-0537d3594a72 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 19:56:07.351882 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.353634 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.356812 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.359185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.360434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.361559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.371826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7f32784a-f0ef-4af4-a77a-da127abd23a1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1339 microversion: 2.20 time: 0.357358 Sep 14 19:56:07.375046 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.compute.rpcapi [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 19:56:07.376769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] Releasing lock "compute-rpcapi-router" {{(pid=132862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 19:56:07.389965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 36/63] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:07 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1339 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:07.409550 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:07.412138 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:07.412670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-97d5a174-352f-4a53-af1a-b11ccad67764 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.608786 Sep 14 19:56:07.415574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 28/64] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:07.423827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.424829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.425583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.426675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.427539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.434879 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.821381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:07.822229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:07.831594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:07.835767 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.836493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.837134 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.842136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:07.842854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:07.843686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:07.863812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:07.879751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0729aa72-3e66-4515-9c24-e1a62637b237 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1240 microversion: 2.1 time: 0.484872 Sep 14 19:56:07.880669 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 37/65] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:07 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1240 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:08.035495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:08.036633 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:08.046814 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:08.049550 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:08.052386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:08.054859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:08.055935 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:08.056744 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:08.092435 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:08.101148 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e2661c69-eddc-4b9e-a980-85280c2f9826 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.284199 Sep 14 19:56:08.103677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 29/66] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:07 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:08.399326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:08.400181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:08.419143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:08.421630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:08.424767 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:08.426632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:08.427272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:08.434513 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:08.555077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:08.563967 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:08.565425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:08.566555 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5280232c-36cb-4ae4-a5fe-4e5dd779cec9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1339 microversion: 2.20 time: 0.171111 Sep 14 19:56:08.592216 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 30/67] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:08 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:08.834455 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:08.867026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-43af2785-9feb-4ced-84bd-6463350ce07b tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.832515 Sep 14 19:56:08.870834 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 38/68] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:08 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:08.913217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:08.914996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:08.950181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:08.950746 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:08.959247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:08.960216 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:08.960976 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:08.961135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:09.127230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:09.127841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:09.136492 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:09.137627 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:09.138323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:09.139189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:09.139837 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:09.140406 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:09.148596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:09.173151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-59d4d648-f661-4e1e-a0c1-6cb0ea120c01 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1288 microversion: 2.1 time: 0.265227 Sep 14 19:56:09.173493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 31/69] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:08 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1288 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:09.349842 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:09.366916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-df5598fa-65df-455f-9e43-354c65bb67aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.243802 Sep 14 19:56:09.367727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 39/70] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:09 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:09.467686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-f0b6a382-5e29-44fd-b60e-54e667fccf78 req-6c47144e-104d-4ff0-b300-14df0fb17d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceccccd7-9977-43ce-ad4f-331394d25cf9", "tag": "0093986a-f452-4790-8240-0584e1a07800"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:09.484512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f0b6a382-5e29-44fd-b60e-54e667fccf78 req-6c47144e-104d-4ff0-b300-14df0fb17d90 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:09.486851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f0b6a382-5e29-44fd-b60e-54e667fccf78 req-6c47144e-104d-4ff0-b300-14df0fb17d90 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:09.487402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f0b6a382-5e29-44fd-b60e-54e667fccf78 req-6c47144e-104d-4ff0-b300-14df0fb17d90 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:09.507799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-f0b6a382-5e29-44fd-b60e-54e667fccf78 req-6c47144e-104d-4ff0-b300-14df0fb17d90 service nova] Creating event network-changed:0093986a-f452-4790-8240-0584e1a07800 for instance ceccccd7-9977-43ce-ad4f-331394d25cf9 on hv-cinder-83976 Sep 14 19:56:09.519522 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-f0b6a382-5e29-44fd-b60e-54e667fccf78 req-6c47144e-104d-4ff0-b300-14df0fb17d90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055589 Sep 14 19:56:09.520304 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 32/71] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:09.599780 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:09.599780 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:09.606946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:09.608949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:09.610244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:09.611371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:09.614133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:09.614637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:09.895933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:09.898130 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:09.911780 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:09.914438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:09.915590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:09.916936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:09.918035 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:09.919007 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:10.266375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:10.301262 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:10.308927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:10.311287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fd1af947-c351-4ed0-8c4a-9a26f48af512 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.718517 Sep 14 19:56:10.314259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 40/72] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:09 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:10.324169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:10.339445 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:10.357258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:10.358078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:10.361137 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:10.362210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:10.362930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:10.364140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:10.451036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:10.467147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2fb58edb-7b41-4ba7-81a5-ca295acc8637 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.577339 Sep 14 19:56:10.473093 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 33/73] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:09 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:10.478134 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:10.484709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:10.485681 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:10.500378 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b640e072-af47-49dc-b4c9-e86726f52ed1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1296 microversion: 2.1 time: 0.184510 Sep 14 19:56:10.513129 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 41/74] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:10 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1296 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:10.513299 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:10.514021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:10.515073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:10.516102 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:10.516817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:10.517386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:11.149421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:11.156606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=67 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:11.158962 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f701b92f-d7da-4932-9208-ee5df28200aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.684511 Sep 14 19:56:11.165628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 34/75] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:10 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:11.345785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:11.348851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:11.387055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:11.388950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:11.389425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:11.390209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:11.390678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:11.398318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:11.541726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c73ec5ea-9606-4ffd-a929-7eea36da5d87 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Action: 'create', calling method: .version_select at 0x7f19e5a9c160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-888703285", "metadata": {"Type": "work"}}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c73ec5ea-9606-4ffd-a929-7eea36da5d87 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Request method failure captured: Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 121 Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHbWB5s9vIhLWxtUeTe8bCZ8uNd48n_XonWgDbuwNmHHCdsXJFi6_TdVwwNKJpyDtM2v9C9Ht3_CssXh8aupBRyyaj_MCwcVpGrRF_5z8hNLnhxPa3IeO6gousEVMSCriixDI1Ogy9ko0rcjqf-1G-q_KIwK5fsPa6oEX9X9DGg3so Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 19:56:11.561118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8e905c078c4edb89146bf44e7889e1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}] Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 26130a0a358749ee903c6e1b46fe5862 Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-888703285", "metadata": {"Type": "work"}}} Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: Sep 14 19:56:11.563076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-888703285', 'metadata': {'Type': 'work'}}}} Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise error Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi '#$%' Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:56:11.563940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 19:56:11.565133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 19:56:11.566231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 19:56:11.566231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:56:11.570372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c73ec5ea-9606-4ffd-a929-7eea36da5d87 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:56:11.577041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c73ec5ea-9606-4ffd-a929-7eea36da5d87 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.294139 Sep 14 19:56:11.580624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 42/76] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 19:56:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 299 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 19:56:11.599480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:11.607923 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:11.631857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:11.636291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:11.636291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:11.640452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:11.649167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:11.661531 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:11.715342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:11.928603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:11.928603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-54d17edd-5e7d-4241-a0eb-60af4ae94866 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.323864 Sep 14 19:56:11.928603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 43/77] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:11 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:11.928603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:11.929022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:11.929022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:11.929022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:11.929022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:11.929297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:11.929297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:11.929297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:12.084429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:12.099267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:12.101717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:12.103268 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-19fd661e-e9af-4052-8c82-07597577ed1f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.768093 Sep 14 19:56:12.104407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 35/78] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:11 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:12.111269 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-75471739-9e46-4d7a-93f4-5a09ddcb2cdd tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Action: 'create', calling method: .version_select at 0x7f19e5aeb3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1799962447", "metadata": {"Type": "work"}}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-75471739-9e46-4d7a-93f4-5a09ddcb2cdd tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Request method failure captured: Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 120 Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHbWB5s9vIhLWxtUeTe8bCZ8uNd48n_XonWgDbuwNmHHCdsXJFi6_TdVwwNKJpyDtM2v9C9Ht3_CssXh8aupBRyyaj_MCwcVpGrRF_5z8hNLnhxPa3IeO6gousEVMSCriixDI1Ogy9ko0rcjqf-1G-q_KIwK5fsPa6oEX9X9DGg3so Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:56:12.146728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8e905c078c4edb89146bf44e7889e1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}] Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 26130a0a358749ee903c6e1b46fe5862 Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1799962447", "metadata": {"Type": "work"}}} Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:56:12.148150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1799962447', 'metadata': {'Type': 'work'}}}} Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise error Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi '0' Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:56:12.148988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 19:56:12.150831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 19:56:12.151899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 19:56:12.151899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.152959 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-75471739-9e46-4d7a-93f4-5a09ddcb2cdd tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:56:12.158530 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-75471739-9e46-4d7a-93f4-5a09ddcb2cdd tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.050492 Sep 14 19:56:12.159354 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 36/79] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 19:56:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 19:56:12.166971 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-f94ebe72-78e4-4977-b159-2a34c5520400 req-cff8a724-677f-42fd-b247-b2502596d494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a", "tag": "127c779f-5b8f-4922-8168-11cb82065f9b"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:12.245250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f94ebe72-78e4-4977-b159-2a34c5520400 req-cff8a724-677f-42fd-b247-b2502596d494 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:12.245250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f94ebe72-78e4-4977-b159-2a34c5520400 req-cff8a724-677f-42fd-b247-b2502596d494 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:12.245250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f94ebe72-78e4-4977-b159-2a34c5520400 req-cff8a724-677f-42fd-b247-b2502596d494 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:12.245250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-f94ebe72-78e4-4977-b159-2a34c5520400 req-cff8a724-677f-42fd-b247-b2502596d494 service nova] Creating event network-changed:127c779f-5b8f-4922-8168-11cb82065f9b for instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a on hv-cinder-83976 Sep 14 19:56:12.246761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:12.246761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-59a6f9c7-7051-4fac-b97b-12df4cdd49b2 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1294 microversion: 2.1 time: 0.296324 Sep 14 19:56:12.246761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 44/80] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:11 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1294 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:12.246761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:12.247320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:12.247320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:12.247320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:12.247320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:12.247929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:12.247929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:12.247929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-f94ebe72-78e4-4977-b159-2a34c5520400 req-cff8a724-677f-42fd-b247-b2502596d494 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061589 Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 37/81] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1b754da8-6096-4ebe-9c51-58faec089101 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Action: 'create', calling method: .version_select at 0x7f19e5a97e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953191923", "metadata": {"Type": "work"}}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1b754da8-6096-4ebe-9c51-58faec089101 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Request method failure captured: Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 118 Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHbWB5s9vIhLWxtUeTe8bCZ8uNd48n_XonWgDbuwNmHHCdsXJFi6_TdVwwNKJpyDtM2v9C9Ht3_CssXh8aupBRyyaj_MCwcVpGrRF_5z8hNLnhxPa3IeO6gousEVMSCriixDI1Ogy9ko0rcjqf-1G-q_KIwK5fsPa6oEX9X9DGg3so Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:56:12.248139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8e905c078c4edb89146bf44e7889e1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}] Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 26130a0a358749ee903c6e1b46fe5862 Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-953191923", "metadata": {"Type": "work"}}} Sep 14 19:56:12.249300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-953191923', 'metadata': {'Type': 'work'}}}} Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise error Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi '' Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.253022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 19:56:12.255599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 19:56:12.257769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 19:56:12.257769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.257769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1b754da8-6096-4ebe-9c51-58faec089101 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:56:12.257769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1b754da8-6096-4ebe-9c51-58faec089101 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009504 Sep 14 19:56:12.257769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 38/82] 10.222.0.42 () {60 vars in 1156 bytes} [Wed Sep 14 19:56:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 19:56:12.257769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c243471e-864b-424a-aaa6-b4f0d1fc565e tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Calling method '.version_select at 0x7f19e5abdee0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:12.303959 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-c243471e-864b-424a-aaa6-b4f0d1fc565e tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] HTTP exception thrown: Volume tempest-invalid-1428264517 could not be found. Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c243471e-864b-424a-aaa6-b4f0d1fc565e tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Request method failure captured: Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1428264517 HTTP/1.1 Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHbWB5s9vIhLWxtUeTe8bCZ8uNd48n_XonWgDbuwNmHHCdsXJFi6_TdVwwNKJpyDtM2v9C9Ht3_CssXh8aupBRyyaj_MCwcVpGrRF_5z8hNLnhxPa3IeO6gousEVMSCriixDI1Ogy9ko0rcjqf-1G-q_KIwK5fsPa6oEX9X9DGg3so Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:56:12.304996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8e905c078c4edb89146bf44e7889e1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}] Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 26130a0a358749ee903c6e1b46fe5862 Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Volume tempest-invalid-1428264517 could not be found. Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'tempest-invalid-1428264517'} Sep 14 19:56:12.306214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1428264517 could not be found. (HTTP 404) (Request-ID: req-d8d3d59c-0bde-46b3-b849-3227bce20721) Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.306944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 19:56:12.308044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1428264517 could not be found. Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:56:12.309055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1428264517 could not be found. Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1428264517 could not be found. Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.310843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c243471e-864b-424a-aaa6-b4f0d1fc565e tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Returning 404 to user: Volume tempest-invalid-1428264517 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:56:12.311966 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c243471e-864b-424a-aaa6-b4f0d1fc565e tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1428264517" status: 404 len: 99 microversion: 2.1 time: 0.067494 Sep 14 19:56:12.313027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 39/83] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 19:56:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1428264517 => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 19:56:12.325427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-37bbbc73-37ef-4712-bbb7-31080939b061 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003734 Sep 14 19:56:12.327335 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 40/84] 10.222.0.42 () {58 vars in 1140 bytes} [Wed Sep 14 19:56:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 19:56:12.336993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-927187f6-fb88-4193-9dc5-3cd78fd1ae1e tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003733 Sep 14 19:56:12.337875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 41/85] 10.222.0.42 () {58 vars in 1137 bytes} [Wed Sep 14 19:56:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 14 19:56:12.347365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-af2e952f-96b9-49d7-976e-f50663688dc7 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Calling method '.version_select at 0x7f19e5aeb4c0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:12.392883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-af2e952f-96b9-49d7-976e-f50663688dc7 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] HTTP exception thrown: Volume dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 could not be found. Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-af2e952f-96b9-49d7-976e-f50663688dc7 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Request method failure captured: Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/os-volumes/dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 HTTP/1.1 Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHbWB5s9vIhLWxtUeTe8bCZ8uNd48n_XonWgDbuwNmHHCdsXJFi6_TdVwwNKJpyDtM2v9C9Ht3_CssXh8aupBRyyaj_MCwcVpGrRF_5z8hNLnhxPa3IeO6gousEVMSCriixDI1Ogy9ko0rcjqf-1G-q_KIwK5fsPa6oEX9X9DGg3so Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:56:12.395231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8e905c078c4edb89146bf44e7889e1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}] Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 26130a0a358749ee903c6e1b46fe5862 Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Volume dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 could not be found. Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9'} Sep 14 19:56:12.396569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 could not be found. (HTTP 404) (Request-ID: req-cb02b42d-143f-4336-b663-3f844a0b9e5e) Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.397408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 19:56:12.398577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 could not be found. Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 19:56:12.399822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 could not be found. Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 could not be found. Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-af2e952f-96b9-49d7-976e-f50663688dc7 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Returning 404 to user: Volume dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-af2e952f-96b9-49d7-976e-f50663688dc7 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9" status: 404 len: 109 microversion: 2.1 time: 0.054216 Sep 14 19:56:12.402409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 42/86] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 19:56:12 2022] DELETE /compute/v2.1/os-volumes/dfc4a03d-3cfd-43d3-afc9-b5fe4e0d40b9 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:56:12.410103 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f7396c51-3b83-4955-ac35-04f02e021b94 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Calling method '.version_select at 0x7f19e5b9b4c0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:12.444301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-f7396c51-3b83-4955-ac35-04f02e021b94 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] HTTP exception thrown: Volume 4610b63b-bcf0-4d80-b2b3-cb53881c0f26 could not be found. Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f7396c51-3b83-4955-ac35-04f02e021b94 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Request method failure captured: Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/os-volumes/4610b63b-bcf0-4d80-b2b3-cb53881c0f26 HTTP/1.1 Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHbWB5s9vIhLWxtUeTe8bCZ8uNd48n_XonWgDbuwNmHHCdsXJFi6_TdVwwNKJpyDtM2v9C9Ht3_CssXh8aupBRyyaj_MCwcVpGrRF_5z8hNLnhxPa3IeO6gousEVMSCriixDI1Ogy9ko0rcjqf-1G-q_KIwK5fsPa6oEX9X9DGg3so Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:56:12.446285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a8e905c078c4edb89146bf44e7889e1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a8e905c078c4edb89146bf44e7889e1"}]}] Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 2a8e905c078c4edb89146bf44e7889e1 Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesNegativeTest-1782885716 Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 26130a0a358749ee903c6e1b46fe5862 Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesNegativeTest-1782885716-project Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Volume 4610b63b-bcf0-4d80-b2b3-cb53881c0f26 could not be found. Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '4610b63b-bcf0-4d80-b2b3-cb53881c0f26'} Sep 14 19:56:12.447414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4610b63b-bcf0-4d80-b2b3-cb53881c0f26 could not be found. (HTTP 404) (Request-ID: req-2bf4fbb9-09c7-4939-a131-65a7b7015db1) Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.448210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 19:56:12.449251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4610b63b-bcf0-4d80-b2b3-cb53881c0f26 could not be found. Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 19:56:12.450466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4610b63b-bcf0-4d80-b2b3-cb53881c0f26 could not be found. Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4610b63b-bcf0-4d80-b2b3-cb53881c0f26 could not be found. Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f7396c51-3b83-4955-ac35-04f02e021b94 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] Returning 404 to user: Volume 4610b63b-bcf0-4d80-b2b3-cb53881c0f26 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f7396c51-3b83-4955-ac35-04f02e021b94 tempest-VolumesNegativeTest-1782885716 tempest-VolumesNegativeTest-1782885716-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4610b63b-bcf0-4d80-b2b3-cb53881c0f26" status: 404 len: 109 microversion: 2.1 time: 0.042797 Sep 14 19:56:12.453305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 43/87] 10.222.0.42 () {58 vars in 1245 bytes} [Wed Sep 14 19:56:12 2022] GET /compute/v2.1/os-volumes/4610b63b-bcf0-4d80-b2b3-cb53881c0f26 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:56:12.463472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:12.471428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e4ce23c0-ecab-4ba1-95f5-b6f670206b5c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.265264 Sep 14 19:56:12.472014 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 45/88] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:12 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:12.952556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:12.953276 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:12.959667 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:12.960143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:12.960579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:12.961258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:12.961717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:12.962162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:13.089815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:13.097934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a4a515aa-4828-463c-81b7-4cd166de0476 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.149209 Sep 14 19:56:13.104773 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 44/89] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:12 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:13.137864 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:13.138507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:13.148255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:13.148255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:13.148255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:13.148255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:13.148599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:13.148599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:13.231134 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:13.240063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:13.243702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:13.244211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:13.244652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:13.245354 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:13.245821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:13.246262 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:13.353791 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:13.366267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3171a3b8-95f1-4ea3-87aa-0d3adedf690c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1294 microversion: 2.1 time: 0.139019 Sep 14 19:56:13.378515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:13.378795 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 45/90] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:13 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:13.381189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:13.383045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:13.384459 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-92be2c09-7e23-4c48-866f-9de039a4b0df tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.250575 Sep 14 19:56:13.385305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 46/91] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:13 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:13.495071 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:13.496094 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:13.503759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:13.504691 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:13.505347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:13.507418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:13.521182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:13.522306 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:13.773292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:13.793345 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c6ff9b7c-163e-4b3f-b76a-c6c24884c84e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.302017 Sep 14 19:56:13.806011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 46/92] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:13 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:14.123629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:14.124374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:14.133131 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:14.136171 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.137063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.137766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:14.138875 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.140530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.142153 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:14.333643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:14.342114 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-723ecd76-08de-46cb-be52-27104fc52dcf tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.224777 Sep 14 19:56:14.342683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 47/93] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:14 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:14.392408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:14.393023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:14.398885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.399372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.399926 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:14.400626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.401115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.401542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:14.411566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:14.412680 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:14.419088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.419642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.420149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:14.421201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.421915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.422519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:14.517092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=32 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:14.559223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:14.568487 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:14.570035 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:14.571170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-740f68c4-882b-4a7e-9405-2a4a18f678b1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.164367 Sep 14 19:56:14.571816 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 48/94] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:14 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:56:14.740256 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:14.748194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9fd69376-2e3e-43d8-8c58-f8e76644bc14 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.360304 Sep 14 19:56:14.748783 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 47/95] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:14 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:14.819719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:14.820339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:14.826342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.826833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.827272 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:14.827997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:14.828454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:14.828872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:15.114225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:15.130802 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9ecccad6-e6fa-43f8-90d8-4ca651205e77 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.313987 Sep 14 19:56:15.133993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 49/96] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:14 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:15.366614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:15.368285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:15.379356 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:15.382386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:15.383160 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:15.384855 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:15.386506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:15.388645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:15.598099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:15.598854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:15.604326 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:15.606772 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:15.607567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:15.608074 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:15.608890 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:15.609412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:15.609924 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:15.626788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:15.634343 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9a736e09-36a5-450f-a7f8-0d434b66d6ee tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.271559 Sep 14 19:56:15.636083 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 48/97] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:15 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:15.771116 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:15.772601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:15.773218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:15.779701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:15.779826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:15.780255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:15.780695 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:15.780870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:15.781388 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:15.781931 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:15.782025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6bd3ec0d-541a-4fd2-a0be-ae4ef298579c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.189475 Sep 14 19:56:15.782425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:15.782530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 50/98] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:15 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:15.927883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:15.935955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9ec6a911-7612-4d61-bf3f-1ebe5aac9d13 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.167056 Sep 14 19:56:15.937449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 49/99] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:15 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:16.155059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:16.155662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:16.162252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.162729 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.163177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.163865 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.164339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.164755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.221739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=22 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:16.337908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:16.351384 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-02eb0dec-3c28-4097-b61e-91153af1a1ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.200135 Sep 14 19:56:16.353841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 51/100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:16 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:16.658032 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:16.658640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:16.666057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.666806 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.667239 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.667933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.668382 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.668803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.798590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:16.806743 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-43e7d3f0-f991-4c53-b1ad-0137d8813ff8 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.152647 Sep 14 19:56:16.807404 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:16.807917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:16 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:16.808857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:16.815305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.815787 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.816247 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.816971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.817418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.818122 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.963355 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:16.966790 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:16.967407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:16.977230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:16.977685 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.978265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.978688 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.979469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:16.980000 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:16.980426 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:16.982104 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:16.983679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-45ea9ab5-1af1-4016-b80e-8fdacf1fef2a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.180279 Sep 14 19:56:16.984835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 52/102] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:16 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:17.125764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:17.134443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a20efa76-c9f5-4fe1-9028-1b2e3cbe4a1d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.178174 Sep 14 19:56:17.135145 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 51/103] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:16 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:17.380217 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:17.380944 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:17.387839 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:17.388339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:17.388899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:17.389600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:17.390088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:17.390518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:17.571426 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:17.580388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3d90742b-7430-4f26-9a29-1806625a0fb1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.203944 Sep 14 19:56:17.594421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 53/104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:17 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:17.844511 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:17.844511 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:17.844511 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=10 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:17.847254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:17.848196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:17.848790 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:17.849651 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:17.850385 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:17.851231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:18.009792 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:18.011328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:18.024668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:18.025438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:18.026142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:18.027199 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:18.028746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:18.029838 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:18.058582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:18.072349 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bf9155fe-7b37-46b8-a0d6-8caa83fa3a91 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.243764 Sep 14 19:56:18.080416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 52/105] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:17 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:18.158867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:18.159490 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:18.166342 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:18.166978 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:18.167272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:18.167972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:18.168429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:18.169268 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:18.228318 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:18.237497 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:18.239145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:18.240438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-91eb8a18-7f82-495f-8d3d-33b1846d1cbd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.234637 Sep 14 19:56:18.241076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 54/106] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:18 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:18.307814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:18.316583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b894df0a-70b9-46fa-9eae-08f4cb65072b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.162659 Sep 14 19:56:18.317151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:18 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:18.616536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:18.617198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:18.623236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:18.623799 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:18.624164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:18.624903 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:18.625345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:18.625903 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:18.791726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:18.795276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d6587233-e743-49f2-ad0f-5d2efc09f9bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.182739 Sep 14 19:56:18.796215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 55/108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:18 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:19.095677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:19.096213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:19.106377 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.106883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.107512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.112967 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.113449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.113967 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.265855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:19.266480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:19.271781 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:19.279174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.279670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.280105 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.280798 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.281250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.281671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.283212 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9a1a10b7-591c-4ec1-9dc2-861c2252e56f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.190381 Sep 14 19:56:19.284144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 54/109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:19 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:19.347627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:19.349196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:19.366726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.369208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.369658 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.370411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.372752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.373936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.465764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:19.475826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:19.477550 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:19.478691 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8f07e588-a26f-4522-8c49-1be4ce36b115 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.216690 Sep 14 19:56:19.490486 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 56/110] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:19 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:56:19.538461 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:19.549447 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7304cbc5-a3a4-4be5-bdaf-ed4512984948 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.213144 Sep 14 19:56:19.551256 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 55/111] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:19 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:19.820973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:19.825248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:19.827425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.827910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.828346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.829024 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:19.829473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:19.829919 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:19.960056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:19.967874 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c66bd0c3-9516-44b5-a22d-69f6ba509238 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.151025 Sep 14 19:56:19.968507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:19 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:20.307672 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:20.308359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:20.315219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:20.315810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:20.316311 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:20.317192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:20.318177 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:20.318810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:20.497243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:20.504200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:20.504788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:20.506801 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-24739a20-1d8b-4dd2-900c-9254f2e6b3b5 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.202999 Sep 14 19:56:20.510325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 56/113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:20 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:20.511397 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:20.511894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:20.512613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:20.513023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:20.513475 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:20.513933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:20.573210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:20.574164 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:20.584127 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:20.585303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:20.585878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:20.586985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:20.588062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:20.590033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:20.683442 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:20.693167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:20.694671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:20.695775 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c3e337f7-d195-4c8a-b3cb-5ad049142b86 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.195558 Sep 14 19:56:20.710261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 58/114] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:20 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:56:20.750938 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:20.759477 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-02359e51-b5b2-4110-a7e8-915981c2103a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.190069 Sep 14 19:56:20.760174 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 57/115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:20 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:20.990769 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:20.991820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:21.003245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.003245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.003245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.003607 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.004025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.004830 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.188528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:21.197064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fa5ca8d8-eb64-49a9-aea1-6966ba5d5f86 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.210029 Sep 14 19:56:21.197640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 59/116] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:20 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:21.532855 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:21.533484 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:21.540046 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.540750 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.541186 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.543215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.543215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.543215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.691267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:21.700328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9e931e42-a59e-4ebf-8d93-23192b85b4b3 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.171708 Sep 14 19:56:21.700892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 58/117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:21 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:21.722554 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:21.723133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:21.731722 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.732298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.732961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.733729 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.734258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.734721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.740088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:21.787394 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:21.788401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:21.795621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.796126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.796600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.797371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:21.798403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:21.799031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:21.803444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=100 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:21.874782 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:21.901880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:21.901880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:21.901880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6b09f562-3f6b-4e63-9669-9b9c654885fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.170703 Sep 14 19:56:21.903745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 60/118] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:21 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:21.947771 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:21.955730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4f772101-942e-42f5-bd21-2a07ffbb7dd0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.172939 Sep 14 19:56:21.956283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 59/119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:21 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:22.221003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:22.221726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:22.228161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:22.228718 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:22.229299 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:22.230089 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:22.230611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:22.231142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:22.377292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:22.385018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-766d833d-8452-4b7e-a695-3e155eaa0d59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.168345 Sep 14 19:56:22.385573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 61/120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:22 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:22.743640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:22.743640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:22.743640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:22.743640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:22.744291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:22.744291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:22.744291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:22.744291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:22.919307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:22.919918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:22.927765 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:22.931690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:22.932166 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:22.933313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:22.933431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:22.933767 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:22.967805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:22.994116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-590cf9ea-fbb1-45b6-9eab-79f24c9ded72 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.267625 Sep 14 19:56:22.994691 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 60/121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:22 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:23.012582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:23.013199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:23.019524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:23.022615 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:23.023254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:23.023983 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:23.024447 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:23.024879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:23.215377 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:23.227943 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7c4ae153-c8da-4ff0-9ca1-ab13d00dfc64 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.220796 Sep 14 19:56:23.234367 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:23.241955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 61/122] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:23 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:23.253926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:23.255634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:23.256926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-51f16acd-151f-44c8-a394-2dfd54b59bcf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.343017 Sep 14 19:56:23.257966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 62/123] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:22 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:23.411807 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:23.411807 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:23.425062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:23.426308 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:23.426944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:23.427946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:23.430152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:23.431011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:23.695831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:23.700022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-b795c8ff-467d-41f8-afa5-31ba476a7b4c req-efa176d3-d0c7-4549-835e-9089f68f2d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb97b57-3da3-4808-904f-c0573b681648", "name": "network-vif-plugged", "status": "completed", "tag": "ab2b0c1b-d779-4157-a89f-cb7977ee37dc"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:23.707305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c6c284d4-25aa-4ed5-8582-ceeecee06b8d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.302646 Sep 14 19:56:23.708140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b795c8ff-467d-41f8-afa5-31ba476a7b4c req-efa176d3-d0c7-4549-835e-9089f68f2d38 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:23.708620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b795c8ff-467d-41f8-afa5-31ba476a7b4c req-efa176d3-d0c7-4549-835e-9089f68f2d38 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:23.709056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b795c8ff-467d-41f8-afa5-31ba476a7b4c req-efa176d3-d0c7-4549-835e-9089f68f2d38 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:23.715202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 62/124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:23 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:23.739265 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-b795c8ff-467d-41f8-afa5-31ba476a7b4c req-efa176d3-d0c7-4549-835e-9089f68f2d38 service nova] Creating event network-vif-plugged:ab2b0c1b-d779-4157-a89f-cb7977ee37dc for instance 6cb97b57-3da3-4808-904f-c0573b681648 on hv-cinder-83976 Sep 14 19:56:23.752372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-b795c8ff-467d-41f8-afa5-31ba476a7b4c req-efa176d3-d0c7-4549-835e-9089f68f2d38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119418 Sep 14 19:56:23.761449 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 63/125] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:23.871161 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-a2cc5190-b355-47c0-a8df-7ddf907232cf req-6ab2790c-6f42-4838-85ec-c8ab30ff72b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70804c4-376b-4606-bd6f-4414c9892629", "tag": "d1e43dde-90ba-4d12-83de-29affbae5075"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:23.898224 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a2cc5190-b355-47c0-a8df-7ddf907232cf req-6ab2790c-6f42-4838-85ec-c8ab30ff72b3 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:23.898224 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a2cc5190-b355-47c0-a8df-7ddf907232cf req-6ab2790c-6f42-4838-85ec-c8ab30ff72b3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:23.898224 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a2cc5190-b355-47c0-a8df-7ddf907232cf req-6ab2790c-6f42-4838-85ec-c8ab30ff72b3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:23.922762 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-a2cc5190-b355-47c0-a8df-7ddf907232cf req-6ab2790c-6f42-4838-85ec-c8ab30ff72b3 service nova] Creating event network-changed:d1e43dde-90ba-4d12-83de-29affbae5075 for instance f70804c4-376b-4606-bd6f-4414c9892629 on hv-cinder-83976 Sep 14 19:56:23.928854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-a2cc5190-b355-47c0-a8df-7ddf907232cf req-6ab2790c-6f42-4838-85ec-c8ab30ff72b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061492 Sep 14 19:56:23.932095 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 63/126] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:24.020893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:24.021862 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:24.028584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.029118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.029563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.030341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.030804 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.031237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.224455 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:24.236874 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ce34a3d6-c7ce-4901-a557-6dc2c92c5767 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.221394 Sep 14 19:56:24.237539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 64/127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:24 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:24.255513 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:24.256498 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:24.262700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.263182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.263611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.264300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.264747 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.265165 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.288112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:24.289068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:24.307956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.309453 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.311328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.312408 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.313023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.313703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.502098 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:24.511063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:24.512695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:24.514137 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-16fb027d-86e0-4f4e-a97f-c75091f4016d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.231647 Sep 14 19:56:24.514692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 65/128] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:24 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:56:24.730191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:24.737953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f01e47cc-1a92-412e-bd49-8b00c33e3947 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.486605 Sep 14 19:56:24.744997 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 64/129] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:24 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:24.745287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:24.745937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:24.753216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.753699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.754200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.754869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:24.755313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:24.758677 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:24.898667 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:24.910857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-87f4a78e-1910-4e04-a8c9-8141008b7ef2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.168944 Sep 14 19:56:24.911890 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 66/130] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:24 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:25.260720 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:25.261952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:25.268817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:25.268817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:25.269334 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:25.270146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:25.270667 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:25.271155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:25.511415 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:25.523361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0b46e3ba-1a5e-406e-93ca-6da95a6e12db tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.266781 Sep 14 19:56:25.524173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 65/131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:25 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:25.544417 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:25.545756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:25.552958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:25.553690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:25.554326 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:25.555085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:25.555600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:25.556228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:25.763004 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:25.767678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:25.786518 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:25.788990 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:25.789706 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:25.790621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:25.791085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:25.791515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:25.950162 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:25.959634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:25.961258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:25.962436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9d86ab59-03e3-4538-880c-7017cb3b913e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.421844 Sep 14 19:56:25.980689 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 67/132] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:25 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:25.987434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-d867ec80-67a9-4858-b129-4c16abfa47b7 req-a1cd4226-f34e-42b2-a7e6-d68182bccb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceccccd7-9977-43ce-ad4f-331394d25cf9", "name": "network-vif-plugged", "status": "completed", "tag": "0093986a-f452-4790-8240-0584e1a07800"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:25.998155 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-d867ec80-67a9-4858-b129-4c16abfa47b7 req-a1cd4226-f34e-42b2-a7e6-d68182bccb06 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:25.998801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-d867ec80-67a9-4858-b129-4c16abfa47b7 req-a1cd4226-f34e-42b2-a7e6-d68182bccb06 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:25.999366 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-d867ec80-67a9-4858-b129-4c16abfa47b7 req-a1cd4226-f34e-42b2-a7e6-d68182bccb06 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:26.009273 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:26.028984 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3bb21056-e07b-4c5f-a1e1-9db74f90ea28 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.264135 Sep 14 19:56:26.052465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 66/133] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:25 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:26.069934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:26.069934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:26.070402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-d867ec80-67a9-4858-b129-4c16abfa47b7 req-a1cd4226-f34e-42b2-a7e6-d68182bccb06 service nova] Creating event network-vif-plugged:0093986a-f452-4790-8240-0584e1a07800 for instance ceccccd7-9977-43ce-ad4f-331394d25cf9 on hv-cinder-83976 Sep 14 19:56:26.083568 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-d867ec80-67a9-4858-b129-4c16abfa47b7 req-a1cd4226-f34e-42b2-a7e6-d68182bccb06 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100604 Sep 14 19:56:26.087731 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:26.089220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 68/134] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:26.091878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:26.092689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:26.098613 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:26.098613 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:26.098613 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:26.348805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:26.360039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-af031745-ea64-4524-bcc0-8f79f6d0ed49 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.306192 Sep 14 19:56:26.361145 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 67/135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:26 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:26.547873 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:26.549204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:26.555598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:26.556079 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:26.556669 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:26.557397 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:26.557869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:26.558325 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:26.688319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:26.696300 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0011b61d-2a68-4f87-abca-343c3b17522c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.152839 Sep 14 19:56:26.696865 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 69/136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:26 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:26.988879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:26.989493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:26.996100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:26.996626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:26.997057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:26.997730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:26.998203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:26.998620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:27.056832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:27.057560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:27.063800 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:27.064224 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:27.064648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:27.065386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:27.065859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:27.066280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:27.151716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:27.169742 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:27.171925 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:27.173354 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f9cb2363-425d-41be-9025-ef18c1112532 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.188745 Sep 14 19:56:27.174501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 68/137] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:26 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:27.312425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:27.321722 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-635ca0f7-6c9c-4c78-b224-a8bc51972a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.268299 Sep 14 19:56:27.329880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 70/138] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:27 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:27.391143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:27.392700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:27.401303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:27.405010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:27.405010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:27.405010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:27.405010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:27.405428 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:27.557049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:27.565454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a107fce2-a096-42a6-8380-277c673211dd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.185594 Sep 14 19:56:27.566291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:27 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:27.719232 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:27.721337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:27.728862 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:27.730001 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:27.731081 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:27.732241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:27.733292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:27.733960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:27.969827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:27.979042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c5c28241-c06d-4804-b015-e0eb52080b94 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.263870 Sep 14 19:56:27.979788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 71/140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:27 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:28.106425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-b097577c-922e-4c80-b924-2938b3cf4f4b req-febf758c-beb2-4a1a-9263-1938ab786670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a", "name": "network-vif-plugged", "status": "completed", "tag": "127c779f-5b8f-4922-8168-11cb82065f9b"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:28.120836 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-b097577c-922e-4c80-b924-2938b3cf4f4b req-febf758c-beb2-4a1a-9263-1938ab786670 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:28.121497 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-b097577c-922e-4c80-b924-2938b3cf4f4b req-febf758c-beb2-4a1a-9263-1938ab786670 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:28.122041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-b097577c-922e-4c80-b924-2938b3cf4f4b req-febf758c-beb2-4a1a-9263-1938ab786670 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:28.137597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-b097577c-922e-4c80-b924-2938b3cf4f4b req-febf758c-beb2-4a1a-9263-1938ab786670 service nova] Creating event network-vif-plugged:127c779f-5b8f-4922-8168-11cb82065f9b for instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a on hv-cinder-83976 Sep 14 19:56:28.162099 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-b097577c-922e-4c80-b924-2938b3cf4f4b req-febf758c-beb2-4a1a-9263-1938ab786670 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060518 Sep 14 19:56:28.166698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 70/141] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:28.203504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:28.204516 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:28.230204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:28.231007 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:28.232182 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:28.233198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:28.233851 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:28.234469 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:28.347572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:28.348286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:28.377902 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:28.378650 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:28.379248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:28.380123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:28.380580 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:28.381163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:28.493661 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:28.502799 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:28.504932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:28.506161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7c17f222-9952-4826-924a-76fa8adf9a73 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.309238 Sep 14 19:56:28.506896 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 72/142] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:28 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:28.533854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:28.547341 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-237e537f-ac57-4ebd-b55d-6af9c4f8d31e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.204615 Sep 14 19:56:28.548491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:28 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:28.600093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:28.600786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:28.612454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:28.612902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:28.613235 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:28.613994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:28.614572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:28.615006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:28.821716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:28.831477 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1a431a46-ac21-4b9a-b4f6-90885e68918b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1321 microversion: 2.1 time: 0.235522 Sep 14 19:56:28.832093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 73/144] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:28 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:29.008429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:29.009639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:29.019391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.020287 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.020866 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.021956 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.022694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.023903 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.178090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:29.185764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3d61fc1c-f781-461b-addf-4f7c357b7647 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.184337 Sep 14 19:56:29.186365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 72/145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:28 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:29.544993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:29.559669 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:29.569418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.569600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.570735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.571575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.572034 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.572468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.576043 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:29.577247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:29.588048 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.588730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.589909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.591411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.592536 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.593353 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.787969 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:29.806491 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:29.808660 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:29.814380 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c3c9625d-bc7d-4ad0-9625-604ff3c08b49 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.282142 Sep 14 19:56:29.814380 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 74/146] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:29 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:29.861152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:29.862721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:29.866984 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:29.871304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.871887 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.872446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.873539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:29.874116 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:29.874553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:29.880340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-49f0909e-328a-4f22-8222-069d4f3c20bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.313206 Sep 14 19:56:29.881228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 73/147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:29 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:30.071307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:30.079021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-dbc9fd11-dda2-4376-bd1b-06f4cf0de045 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1514 microversion: 2.1 time: 0.223755 Sep 14 19:56:30.079645 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 75/148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:29 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:30.107907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:30.110246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:30.116799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.117260 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.117702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.118819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.119500 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.119935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.188080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'flavor' on Instance uuid ceccccd7-9977-43ce-ad4f-331394d25cf9 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:56:30.210534 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:30.211270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:30.218588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.219252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.219839 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.221084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.221920 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.222481 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.395869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:30.411101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9ee279b6-1eca-49d3-ad18-fd62fabb1bc1 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.204091 Sep 14 19:56:30.412075 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 76/149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:30 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:30.417308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-f487ee4b-a56c-4c26-b855-5ab32590590f req-d410a006-8454-4572-a529-2159138eb83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3697671d-a339-45b8-92af-541bad612c17", "name": "network-vif-plugged", "status": "completed", "tag": "7728d07e-6f92-4423-898e-e72e31a50d1d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:30.427898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-f487ee4b-a56c-4c26-b855-5ab32590590f req-d410a006-8454-4572-a529-2159138eb83e service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.428576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-f487ee4b-a56c-4c26-b855-5ab32590590f req-d410a006-8454-4572-a529-2159138eb83e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.429171 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-f487ee4b-a56c-4c26-b855-5ab32590590f req-d410a006-8454-4572-a529-2159138eb83e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.441539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-f487ee4b-a56c-4c26-b855-5ab32590590f req-d410a006-8454-4572-a529-2159138eb83e service nova] Creating event network-vif-plugged:7728d07e-6f92-4423-898e-e72e31a50d1d for instance 3697671d-a339-45b8-92af-541bad612c17 on hv-cinder-83976 Sep 14 19:56:30.447323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-f487ee4b-a56c-4c26-b855-5ab32590590f req-d410a006-8454-4572-a529-2159138eb83e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033713 Sep 14 19:56:30.448308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 77/150] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:30.628356 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d928c765-2197-443f-9686-69d6c811b378 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9/action" status: 200 len: 32 microversion: 2.1 time: 0.524404 Sep 14 19:56:30.636664 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 74/151] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:56:30 2022] POST /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:56:30.645517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:30.646526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:30.652812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.653301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.653980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.654676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.655290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.655762 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.840869 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:30.841781 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:30.853192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.854567 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.858080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.858850 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.859311 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.859735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.864451 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:30.877485 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:30.881756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ace63368-cae3-41c0-a4fc-5d4c70f979c9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.235172 Sep 14 19:56:30.883657 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 78/152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:30 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:30.891444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:30.913989 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:30.916602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:30.926975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.927866 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.928955 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:30.930447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:30.931499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:30.934805 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:31.142933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:31.152722 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:31.154219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:31.155349 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-59e441b8-6174-42a7-bbdf-bde2ea3ee5ae tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1406 microversion: 2.20 time: 0.320192 Sep 14 19:56:31.155906 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 75/153] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:30 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:31.176316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:31.186528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e2cff193-5700-4cd6-b7b9-f92a59de37c3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.283875 Sep 14 19:56:31.190950 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 79/154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:30 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:31.440928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:31.441739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:31.462255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:31.472858 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:31.472858 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:31.472858 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:31.472858 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:31.473340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:31.802382 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:31.825234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a5543531-dbee-4bd2-bd73-0cd80f01c5e4 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1315 microversion: 2.1 time: 0.388067 Sep 14 19:56:31.841679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 76/155] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:31 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:31.912188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:31.912821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:31.920170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:31.920665 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:31.921128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:31.921831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:31.922273 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:31.922823 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.070652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:32.079019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cb1eb46d-67cb-4c9c-adc3-4b1d6881b039 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.174365 Sep 14 19:56:32.080135 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 80/156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:31 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:32.193044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:32.193833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:32.200860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.201353 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.201876 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.202574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.203019 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.203630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.216634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:32.217663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:32.230675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.231902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.233920 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.235241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.236897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.238472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.394808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:32.406060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:32.408192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:32.409891 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d7411069-fa4c-4ecb-bfea-65ee00e13124 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1599 microversion: 2.20 time: 0.225429 Sep 14 19:56:32.413052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 77/157] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:56:32 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:56:32.431443 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:32.439724 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8454f3ac-d7cc-4548-90cb-bf63590a2cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.228868 Sep 14 19:56:32.440382 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 81/158] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:32 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:32.444518 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:32.445019 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:32.451312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.452319 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.452829 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.453588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.454079 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.459045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.467341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-0f0d812f-0514-436c-9495-29b468d19e7e req-e1ddfe44-9ae7-4025-a1ad-cbea6bf91ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70804c4-376b-4606-bd6f-4414c9892629", "name": "network-vif-plugged", "status": "completed", "tag": "d1e43dde-90ba-4d12-83de-29affbae5075"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:32.477188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0f0d812f-0514-436c-9495-29b468d19e7e req-e1ddfe44-9ae7-4025-a1ad-cbea6bf91ce7 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.478211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0f0d812f-0514-436c-9495-29b468d19e7e req-e1ddfe44-9ae7-4025-a1ad-cbea6bf91ce7 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.478887 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0f0d812f-0514-436c-9495-29b468d19e7e req-e1ddfe44-9ae7-4025-a1ad-cbea6bf91ce7 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.491610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-0f0d812f-0514-436c-9495-29b468d19e7e req-e1ddfe44-9ae7-4025-a1ad-cbea6bf91ce7 service nova] Creating event network-vif-plugged:d1e43dde-90ba-4d12-83de-29affbae5075 for instance f70804c4-376b-4606-bd6f-4414c9892629 on hv-cinder-83976 Sep 14 19:56:32.496663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-0f0d812f-0514-436c-9495-29b468d19e7e req-e1ddfe44-9ae7-4025-a1ad-cbea6bf91ce7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Sep 14 19:56:32.497285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 82/159] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:56:32.542016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-83140b06-709c-4458-8f23-60328bddb7b0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101782 Sep 14 19:56:32.542701 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 78/160] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Sep 14 19:56:32 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:56:32.853268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:32.853268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:32.872498 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.873289 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.874098 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:32.875440 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:32.876142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:32.876878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:33.108006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:33.109454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:33.119694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:33.120270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:33.120975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:33.124564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:33.125113 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:33.125655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:33.232010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:33.250669 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d72f3b16-6c4b-4237-ac69-ec5b764e1c5c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1503 microversion: 2.1 time: 0.403271 Sep 14 19:56:33.252986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 83/161] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:32 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1503 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:33.358990 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:33.377558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9d5361cd-6047-425c-876b-036608557ec6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.274777 Sep 14 19:56:33.391928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:33 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:33.469949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:33.471641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:33.480691 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:33.483616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:33.484232 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:33.485300 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:33.486918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:33.491393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:33.685689 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:33.698817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ae0988d5-f8fa-4a7c-8116-a8f5591d7ad5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.234182 Sep 14 19:56:33.699726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 84/163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:33 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:34.403124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:34.404649 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:34.413450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:34.414381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:34.415041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:34.415976 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:34.416508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:34.417155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:34.538909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-2bc9a1cc-aebe-44c8-8b49-2a8993fdeee0 req-533f9719-ed63-4da1-87aa-b5e4878e8331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a", "tag": "127c779f-5b8f-4922-8168-11cb82065f9b"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:34.550912 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-2bc9a1cc-aebe-44c8-8b49-2a8993fdeee0 req-533f9719-ed63-4da1-87aa-b5e4878e8331 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:34.551656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-2bc9a1cc-aebe-44c8-8b49-2a8993fdeee0 req-533f9719-ed63-4da1-87aa-b5e4878e8331 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:34.552258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-2bc9a1cc-aebe-44c8-8b49-2a8993fdeee0 req-533f9719-ed63-4da1-87aa-b5e4878e8331 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:34.581568 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:34.587830 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-2bc9a1cc-aebe-44c8-8b49-2a8993fdeee0 req-533f9719-ed63-4da1-87aa-b5e4878e8331 service nova] Creating event network-changed:127c779f-5b8f-4922-8168-11cb82065f9b for instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a on hv-cinder-83976 Sep 14 19:56:34.593728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-860a5582-0f9d-4467-91ed-b8726ed0fcfd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.195442 Sep 14 19:56:34.594727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 80/164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:34 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:34.612608 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-2bc9a1cc-aebe-44c8-8b49-2a8993fdeee0 req-533f9719-ed63-4da1-87aa-b5e4878e8331 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077172 Sep 14 19:56:34.613237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 85/165] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:56:34.722415 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:34.723014 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:34.732470 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:34.732958 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:34.733385 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:34.734110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:34.734559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:34.734983 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:34.937280 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:34.946612 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b2c57e8d-1e5d-4a52-9c50-f455dd45fb41 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.228025 Sep 14 19:56:34.947452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 81/166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:34 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:35.618334 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:35.619021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:35.625201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:35.625905 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:35.626297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:35.627600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:35.628063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:35.628480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:35.776428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:35.784593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d4648394-b014-4c71-854b-cef5f0ef1d51 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.170392 Sep 14 19:56:35.785589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 86/167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:35 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:35.970893 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:35.971806 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:35.980357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:35.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:35.982442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:35.985237 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:35.986399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:35.988205 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:36.244679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:36.254085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-63489e5e-cb70-4185-a63a-54b5acc93775 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.287667 Sep 14 19:56:36.268697 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 82/168] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:35 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:36.809291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:36.810598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:36.817765 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:36.818642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:36.819376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:36.820078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:36.820530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:36.820950 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:36.981586 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:36.990456 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a0d90c4a-5670-4189-bc98-52a778d0fbe7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.185695 Sep 14 19:56:36.991113 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 87/169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:36 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:37.279376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:37.280357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:37.292608 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:37.293403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:37.294479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:37.295476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:37.296277 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:37.297132 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:37.671588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:37.679909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-22584f59-26c2-4411-b593-62fa963469df tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1362 microversion: 2.1 time: 0.405254 Sep 14 19:56:37.686389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 83/170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:37 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:38.017653 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:38.018341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:38.031247 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:38.031749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:38.032252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:38.033972 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:38.038053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:38.038776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:38.202184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:38.202184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d901e70d-314c-4d32-8e8f-5cb8cdb35405 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.190953 Sep 14 19:56:38.202184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 88/171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:38 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:38.635249 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7999364d-a420-4c5c-b39f-dafecdc48cc7"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:38.637861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:38.654077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:38.654585 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:38.655021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:38.655917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:38.656534 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:38.666510 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:38.703575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:38.704169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:38.711426 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:38.718191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:38.726488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:38.726488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:38.726488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:38.729585 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:39.073763 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:39.090279 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1231f38a-97c7-4fe4-9c54-fe8b316acc74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1548 microversion: 2.1 time: 0.384578 Sep 14 19:56:39.090279 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 89/172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:38 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1548 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:39.109535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:39.110165 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:39.127547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:39.127547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:39.127547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:39.127547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:39.127819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:39.127819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:39.310347 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1f8df7ca-1f67-45d9-be58-bb2aa8f83405 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205754 Sep 14 19:56:39.311034 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 90/173] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 19:56:39 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:56:39.315994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:39.316598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:39.324099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:39.324593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:39.325024 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:39.325715 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:39.326190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:39.326612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:39.688348 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:39.698495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-90c0ffe4-c0c0-496a-a906-2fbe70ce6f18 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.386376 Sep 14 19:56:39.702574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 91/174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:39 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:39.916158 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-97f39156-5b29-4de6-ba66-633c7f749acb tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "POST /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.286684 Sep 14 19:56:39.917443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 84/175] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:56:38 2022] POST /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:40.730089 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:40.732286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:40.749095 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:40.750058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:40.750790 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:40.752175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:40.752938 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:40.753588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:41.217987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:41.231872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7a6f2e28-4c13-4ab7-85b4-1be986270996 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.509722 Sep 14 19:56:41.235432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 92/176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:40 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:41.483828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-aaca60df-a242-4b58-aa7a-581e44ca1e67 req-dbbab598-33b7-4295-9e36-f6e3d5a17eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70804c4-376b-4606-bd6f-4414c9892629", "tag": "d1e43dde-90ba-4d12-83de-29affbae5075"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:41.493932 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=97 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:41.496506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-aaca60df-a242-4b58-aa7a-581e44ca1e67 req-dbbab598-33b7-4295-9e36-f6e3d5a17eac service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:41.497242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-aaca60df-a242-4b58-aa7a-581e44ca1e67 req-dbbab598-33b7-4295-9e36-f6e3d5a17eac service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:41.497775 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-aaca60df-a242-4b58-aa7a-581e44ca1e67 req-dbbab598-33b7-4295-9e36-f6e3d5a17eac service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:41.510423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-aaca60df-a242-4b58-aa7a-581e44ca1e67 req-dbbab598-33b7-4295-9e36-f6e3d5a17eac service nova] Creating event network-changed:d1e43dde-90ba-4d12-83de-29affbae5075 for instance f70804c4-376b-4606-bd6f-4414c9892629 on hv-cinder-83976 Sep 14 19:56:41.516551 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-aaca60df-a242-4b58-aa7a-581e44ca1e67 req-dbbab598-33b7-4295-9e36-f6e3d5a17eac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037629 Sep 14 19:56:41.521230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 85/177] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:42.257738 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:42.258814 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:42.271031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:42.274202 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:42.274841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:42.275592 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:42.276059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:42.281760 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:42.612898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:42.622827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-be67b54f-a0b1-4616-befa-402ea9c86f6f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.368669 Sep 14 19:56:42.623844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 93/178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:42 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:43.665165 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:43.669338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:43.678025 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:43.682418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:43.683026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:43.683882 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:43.684481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:43.684923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:43.932096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:43.939371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9b9ffad8-57df-45e3-99dc-0a485a332722 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.288429 Sep 14 19:56:43.951059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 86/179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:43 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:44.964674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:44.965218 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:44.971697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:44.972218 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:44.972849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:44.973555 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:44.974036 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:44.974475 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:45.132746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:45.143289 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6e8d0739-aa08-410a-93d0-f13812783f1a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.182468 Sep 14 19:56:45.143871 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 94/180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:44 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:46.167592 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:46.168284 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:46.179037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:46.180795 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:46.181444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:46.184016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:46.184486 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:46.184917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:46.460487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:46.470058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-782e2bfa-3883-431d-ab21-7e3c11ffac65 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.306343 Sep 14 19:56:46.471650 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 87/181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:46 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:47.495815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:47.498028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:47.507530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:47.508210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:47.508722 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:47.509528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:47.510108 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:47.510602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:47.733014 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:47.749921 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-29586369-f5d4-4c0c-af1e-78c0e38e94b8 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.260355 Sep 14 19:56:47.751024 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 95/182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:47 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:48.775129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:48.775982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:48.782674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:48.783429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:48.784089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:48.784854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:48.785792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:48.786450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:49.149879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:49.160814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-95243503-294f-4d7d-958e-e7199bebc46b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.389988 Sep 14 19:56:49.161550 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 88/183] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:48 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:50.191517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:50.192131 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:50.195019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=92 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:50.205620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:50.206156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:50.208820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:50.208820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:50.208820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:50.208820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:50.394043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:50.404218 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d167a66a-c623-4f7c-a0ec-6af814211577 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.216472 Sep 14 19:56:50.410228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 96/184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:50 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:51.322068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:51.323075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:51.332366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:51.337317 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:51.338467 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:51.339834 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:51.341617 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:51.342242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:51.412692 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 19:56:51.443183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:51.443183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:51.448966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:51.449578 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:51.450048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:51.453326 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:51.454398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:51.455631 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:51.463618 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:51.579569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:56:51.650299 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:51.660460 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-17a906d2-494b-484f-9b6b-c72d979468ce tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.235664 Sep 14 19:56:51.662693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 97/185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:51 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:51.867493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-570e6b43-c880-410c-ad1d-e7b1ebc85c06 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 204 len: 0 microversion: 2.1 time: 0.530972 Sep 14 19:56:51.879442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 89/186] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 19:56:51 2022] DELETE /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:56:51.889892 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:51.890515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:51.902734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:51.904937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:51.907836 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:51.908629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:51.909165 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:51.909615 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:52.154734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:52.154734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-be42020a-9945-4628-a0f5-3a0e29b1bd27 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1555 microversion: 2.1 time: 0.222795 Sep 14 19:56:52.154734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 98/187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:51 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:52.688868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:52.690359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:52.699416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:52.700174 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:52.700793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:52.702079 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:52.702879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:52.703459 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:53.071089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:53.079463 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ff80cca1-58fa-4307-9868-b75b9379f530 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.395104 Sep 14 19:56:53.080104 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 90/188] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:52 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:53.165162 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:53.165940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:53.185258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:53.185883 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:53.186581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:53.187368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:53.187893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:53.188412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:53.388590 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:53.399423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a0350ac8-c292-44bb-9651-358e80359f1c tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1555 microversion: 2.1 time: 0.238086 Sep 14 19:56:53.400281 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 99/189] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:53 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:54.104181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:54.104800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:54.122637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:54.123330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:54.123935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:54.124799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:54.125495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:54.126152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:54.443983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:54.445612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:54.455688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:54.457878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:54.458503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:54.461470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:54.462730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:54.464399 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:54.576567 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:54.588724 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0a8fc5bb-1b5e-4d4c-ac63-7393a05b0ea4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.488515 Sep 14 19:56:54.589521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 91/190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:54 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:54.674648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:54.692038 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e66992d4-8e62-4843-8b86-2c1666e9ca52 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1555 microversion: 2.1 time: 0.265076 Sep 14 19:56:54.692038 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 100/191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:54 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:55.349254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-d9891a9b-6229-4232-baa4-9a0c98b27223 req-5eae0ea9-f659-41ee-aef4-2c6be673eb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3697671d-a339-45b8-92af-541bad612c17", "name": "network-vif-deleted", "tag": "7728d07e-6f92-4423-898e-e72e31a50d1d"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:56:55.360899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-d9891a9b-6229-4232-baa4-9a0c98b27223 req-5eae0ea9-f659-41ee-aef4-2c6be673eb9f service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:55.362497 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-d9891a9b-6229-4232-baa4-9a0c98b27223 req-5eae0ea9-f659-41ee-aef4-2c6be673eb9f service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:55.362943 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-d9891a9b-6229-4232-baa4-9a0c98b27223 req-5eae0ea9-f659-41ee-aef4-2c6be673eb9f service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:55.380023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-d9891a9b-6229-4232-baa4-9a0c98b27223 req-5eae0ea9-f659-41ee-aef4-2c6be673eb9f service nova] Creating event network-vif-deleted:7728d07e-6f92-4423-898e-e72e31a50d1d for instance 3697671d-a339-45b8-92af-541bad612c17 on hv-cinder-83976 Sep 14 19:56:55.387737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-d9891a9b-6229-4232-baa4-9a0c98b27223 req-5eae0ea9-f659-41ee-aef4-2c6be673eb9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042881 Sep 14 19:56:55.388471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 92/192] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:56:55.612991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:55.613826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:55.620195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:55.621018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:55.621665 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:55.622635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:55.623285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:55.623909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:55.721548 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:55.724205 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:55.729387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:55.730012 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:55.730550 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:55.731408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:55.731966 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:55.732498 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:55.782752 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:55.796294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-427f1f9e-2740-4190-b734-bcad075d0030 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.186981 Sep 14 19:56:55.810960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 101/193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:55 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:55.811391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:55.829363 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-af58f3a7-0888-4fa3-9ef9-4034567e2c61 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1513 microversion: 2.1 time: 0.107839 Sep 14 19:56:55.829363 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 93/194] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:55 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1513 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:56.823306 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:56.834187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:56.837099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:56.837673 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:56.839776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:56.840519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:56.840994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:56.841425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:56.855471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:56.856793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:56.889116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:56.892699 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:56.897596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:56.898402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:56.898884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:56.899314 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:56.974698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:56.984726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4f96caab-5e2b-46b3-9d54-af4318126d90 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1513 microversion: 2.1 time: 0.133371 Sep 14 19:56:56.985358 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 94/195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:56 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1513 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:57.051840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:57.060583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-52724260-840a-49d1-b9fa-e4317c2282bb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.242982 Sep 14 19:56:57.073854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 102/196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:56 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:58.011648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:58.012248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:58.021775 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:58.022476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:58.023775 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:58.024704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:58.025562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:58.026260 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:58.087402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:58.088835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:58.100450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:58.106118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:58.106118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:58.106118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:58.106118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:58.106574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:58.113302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:58.124940 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3194c822-f9ea-48e4-be90-1277d4e1ea3f tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1346 microversion: 2.1 time: 0.118376 Sep 14 19:56:58.125704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 95/197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:58 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:58.323897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:58.333358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0cf26706-759d-4eb5-ad17-4249678ffa59 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.250228 Sep 14 19:56:58.333985 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 103/198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:58 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:56:59.151743 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:59.153250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:59.159726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:59.160215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:59.160642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:59.161327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:59.161769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:59.162281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:59.193345 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:59.193879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:59.194261 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:59.194698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lazy-loading 'fault' on Instance uuid 3697671d-a339-45b8-92af-541bad612c17 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:56:59.239511 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96428b8e76314536a9e7033a841454e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b04e9cb110f049d69a2d2747c74c8b51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:59.249025 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e91fb709-e119-48f3-b347-64eace2d6b71 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 200 len: 1351 microversion: 2.1 time: 0.101171 Sep 14 19:56:59.249668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 96/199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:59 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:56:59.356662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:56:59.357273 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:56:59.363754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:59.364257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:59.364677 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:59.387261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:56:59.387261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:56:59.387261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:56:59.499667 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:56:59.508535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-50131a54-76bd-4be9-b564-2e94b05b69b1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.155855 Sep 14 19:56:59.509092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 104/200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:56:59 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:00.273454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:00.274229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:00.282487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:00.283387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:00.287236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:00.287236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:00.287236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:00.287236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:00.307337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] HTTP exception thrown: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Request method failure captured: Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 HTTP/1.1 Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHDFEO2YNjf26y82gH8YIbN9Sr5yuAuE-7aNvlEChtZLkx5YxyZ6RhejVpv2Kd5hQ0UQFF21p9yCa0MhV1CKd2JxyxaGIOv5qOSShWq5cY5c07o5Yt-dT7_4L1649bj0n9FkqzAtmudwzds_294jSot4QIFCx8HZI2R3GR0hD-HOHw Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:57:00.316129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b04e9cb110f049d69a2d2747c74c8b51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}] Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 96428b8e76314536a9e7033a841454e2 Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.317444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '3697671d-a339-45b8-92af-541bad612c17'} Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:57:00.318189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.319433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.322446 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Returning 404 to user: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:57:00.323553 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-de4658a2-a7ca-48d5-90e1-5303a99bdf48 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 404 len: 111 microversion: 2.1 time: 0.054909 Sep 14 19:57:00.324734 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 97/201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:00 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:57:00.450425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:00.464685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:00.464948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:00.465628 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:00.466092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:00.467312 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:00.467918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:00.468494 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:00.483266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] HTTP exception thrown: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Request method failure captured: Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17/os-volume_attachments HTTP/1.1 Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHDFEO2YNjf26y82gH8YIbN9Sr5yuAuE-7aNvlEChtZLkx5YxyZ6RhejVpv2Kd5hQ0UQFF21p9yCa0MhV1CKd2JxyxaGIOv5qOSShWq5cY5c07o5Yt-dT7_4L1649bj0n9FkqzAtmudwzds_294jSot4QIFCx8HZI2R3GR0hD-HOHw Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 19:57:00.491185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b04e9cb110f049d69a2d2747c74c8b51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}] Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 96428b8e76314536a9e7033a841454e2 Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.492350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'server_id': '3697671d-a339-45b8-92af-541bad612c17'} Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:57:00.492988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:00.494080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:00.495150 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Returning 404 to user: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:57:00.495538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ae2d9d13-3817-4bd4-af21-fef12267a812 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049149 Sep 14 19:57:00.499313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 105/202] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 19:57:00 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:57:00.540410 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:00.541464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:00.555694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:00.556414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:00.557213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:00.558442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:00.562365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:00.563017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:00.756444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:00.764663 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-92e282a8-1aee-4748-93b6-853725b3c417 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.228757 Sep 14 19:57:00.765228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 98/203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:00 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:01.789674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:01.790981 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:01.797789 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:01.798650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:01.800058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:01.801011 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:01.801756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:01.802340 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:02.019936 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:02.041579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:02.043096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:02.061942 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:02.062836 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:02.063527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:02.064858 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:02.068122 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:02.069481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:02.074703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1bd1ea02-ecb1-4327-a0e9-76ea6ec190f2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.289577 Sep 14 19:57:02.097368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 106/204] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:01 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:02.121605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] HTTP exception thrown: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Request method failure captured: Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 HTTP/1.1 Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHDFEO2YNjf26y82gH8YIbN9Sr5yuAuE-7aNvlEChtZLkx5YxyZ6RhejVpv2Kd5hQ0UQFF21p9yCa0MhV1CKd2JxyxaGIOv5qOSShWq5cY5c07o5Yt-dT7_4L1649bj0n9FkqzAtmudwzds_294jSot4QIFCx8HZI2R3GR0hD-HOHw Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:57:02.127340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b04e9cb110f049d69a2d2747c74c8b51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}] Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 96428b8e76314536a9e7033a841454e2 Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.128769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '3697671d-a339-45b8-92af-541bad612c17'} Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:57:02.129464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.130662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.134943 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Returning 404 to user: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:57:02.150142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a62ecc92-5eec-4919-ab1c-a24a0cdd3ca6 tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 404 len: 111 microversion: 2.1 time: 0.119833 Sep 14 19:57:02.150142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 99/205] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 19:57:02 2022] DELETE /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:57:02.167824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:02.168488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] [instance: 3697671d-a339-45b8-92af-541bad612c17] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:02.179748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:02.180249 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:02.182352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:02.182352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:02.187476 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:02.187946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:02.207290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] HTTP exception thrown: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Request method failure captured: Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 HTTP/1.1 Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHDFEO2YNjf26y82gH8YIbN9Sr5yuAuE-7aNvlEChtZLkx5YxyZ6RhejVpv2Kd5hQ0UQFF21p9yCa0MhV1CKd2JxyxaGIOv5qOSShWq5cY5c07o5Yt-dT7_4L1649bj0n9FkqzAtmudwzds_294jSot4QIFCx8HZI2R3GR0hD-HOHw Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 19:57:02.209432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b04e9cb110f049d69a2d2747c74c8b51", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04e9cb110f049d69a2d2747c74c8b51"}]}] Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: b04e9cb110f049d69a2d2747c74c8b51 Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-DeleteServersTestJSON-367583228 Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 96428b8e76314536a9e7033a841454e2 Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-DeleteServersTestJSON-367583228-project Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.210845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '3697671d-a339-45b8-92af-541bad612c17'} Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:57:02.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. Sep 14 19:57:02.212690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 19:57:02.214821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] Returning 404 to user: Instance 3697671d-a339-45b8-92af-541bad612c17 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:57:02.215927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b67a9a16-b341-4313-80bb-54e3d7ad715d tempest-DeleteServersTestJSON-367583228 tempest-DeleteServersTestJSON-367583228-project] 10.222.0.42 "GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17" status: 404 len: 111 microversion: 2.1 time: 0.064480 Sep 14 19:57:02.216963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 107/206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:02 2022] GET /compute/v2.1/servers/3697671d-a339-45b8-92af-541bad612c17 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:57:03.108063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:03.108678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:03.115287 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:03.116263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:03.116263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:03.117029 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:03.117708 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:03.118226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:03.252360 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:03.261058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b4a01853-2f7a-4bce-9aa9-5625ac8164ea tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.158702 Sep 14 19:57:03.261621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 100/207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:03 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:04.284965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:04.287400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:04.312270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:04.321441 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:04.322159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:04.322938 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:04.323422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:04.323856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:04.570098 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:04.578893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7433bc40-ade9-4a91-a72c-0591834d33cd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.298208 Sep 14 19:57:04.579688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 108/208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:04 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:04.691599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d00b6d9e-8914-473b-b481-6c9f5eadc673 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Action: 'create', calling method: .version_select at 0x7f19e577ba60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-727295590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGi4txNrXnCTb83zzUd8f4nn99KVNmLPSeh+THnCTuHC8rtFY36IWl95htZIjW3ZtitrGW1lqI+aFTqD/1mJa4KRmi1ygXAL6rtMyjMEgnk1MgzGRIZct5/eu3ei3nMuWg=="}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:04.713156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-d00b6d9e-8914-473b-b481-6c9f5eadc673 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Getting quotas for project 11fae649642b4703b649d02268bdb4eb. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:57:04.718372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-d00b6d9e-8914-473b-b481-6c9f5eadc673 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Getting quotas for user 0ebafc08399c4853959800883742eb78 and project 11fae649642b4703b649d02268bdb4eb. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:57:04.846313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d00b6d9e-8914-473b-b481-6c9f5eadc673 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.159313 Sep 14 19:57:04.853434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 101/209] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 19:57:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:04.977711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-609941397", "imageRef": "6d967305-54f3-46f4-8a45-c8eb7140d95b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-727295590", "networks": [{"uuid": "ff06232f-8fc7-4f37-8968-59555a326589"}]}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:05.043266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] validate_networks() for [('ff06232f-8fc7-4f37-8968-59555a326589', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:57:05.604196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:05.604913 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:05.610979 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:05.611461 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:05.612417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:05.613132 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:05.613584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:05.614040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:05.661730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:57:05.663703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:57:05.664472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:57:05.665035 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:57:05.665464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:57:05.679675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:05.679675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:05.680315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:05.681302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:05.682414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:05.683030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:05.734152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Getting quotas for project 11fae649642b4703b649d02268bdb4eb. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:57:05.739437 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Getting quotas for user 0ebafc08399c4853959800883742eb78 and project 11fae649642b4703b649d02268bdb4eb. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:57:05.755000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:57:05.757591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6d967305-54f3-46f4-8a45-c8eb7140d95b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:57:05.811234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:05.826492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3cecc311-1ae8-49ac-bf3d-28c7ad6f723b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.227586 Sep 14 19:57:05.827073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 102/210] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:05 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:05.974120 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-080e8273-1a39-475b-bef8-31437512ca2e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001680 Sep 14 19:57:05.974810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 109/211] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:57:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:57:05.990518 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2e1c7a3c-4109-4a7e-ac09-63a984753d3b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:05.991159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2e1c7a3c-4109-4a7e-ac09-63a984753d3b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:06.080103 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2e1c7a3c-4109-4a7e-ac09-63a984753d3b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:06.089600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2e1c7a3c-4109-4a7e-ac09-63a984753d3b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1257 microversion: 2.1 time: 0.106965 Sep 14 19:57:06.090695 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 103/212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:05 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1257 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:06.857351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:06.861290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:06.879599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:06.880483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:06.884831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:06.885583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:06.886033 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:06.886458 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:07.068282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:07.078822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-44c8765c-5982-4eb8-b12e-1d620f767a44 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.231324 Sep 14 19:57:07.079876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 110/213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:06 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:07.116483 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0bd49679-a3f5-4f8a-a3e0-0f8c93aca660 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:07.117504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0bd49679-a3f5-4f8a-a3e0-0f8c93aca660 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:07.186480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0bd49679-a3f5-4f8a-a3e0-0f8c93aca660 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:07.194594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0bd49679-a3f5-4f8a-a3e0-0f8c93aca660 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1257 microversion: 2.1 time: 0.082582 Sep 14 19:57:07.195240 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 104/214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:07 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1257 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:08.104655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:08.105244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:08.112341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:08.112828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:08.113280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:08.113998 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:08.114453 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:08.114876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:08.219383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:08.221635 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:08.227165 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:08.227652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:08.228359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:08.229053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:08.229669 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:08.230121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:08.274565 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:08.286773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3d58b10d-a44a-4320-be51-22a91256e480 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.185287 Sep 14 19:57:08.287771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 111/215] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:08 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:08.318962 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:08.327368 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-101c7357-0532-41a9-8190-9b3782530beb tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1253 microversion: 2.1 time: 0.111799 Sep 14 19:57:08.327946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 105/216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:08 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1253 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:09.323318 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:09.323932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:09.332491 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:09.333006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:09.333466 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:09.334453 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:09.334909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:09.335330 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:09.364452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:09.367212 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:09.387875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:09.388712 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:09.389704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:09.391293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:09.392008 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:09.392802 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:09.544744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:09.560607 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6675be5e-cb38-43f1-a544-7f97f806d885 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1317 microversion: 2.1 time: 0.205651 Sep 14 19:57:09.562330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 106/217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:09 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:09.772704 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:09.780832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fa57dbf6-3267-4b27-a537-c31a24ab3052 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.471825 Sep 14 19:57:09.782101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 112/218] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:09 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:10.590449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:10.591065 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:10.602585 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:10.608038 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:10.614932 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:10.616651 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:10.620448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:10.621316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:10.815948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:10.818488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:10.836517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:10.837059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:10.843829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:10.844837 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:10.850885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:10.851571 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:11.005436 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:11.023330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fe713ada-c223-4bfc-ab0d-c71ae20b3dc5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.436656 Sep 14 19:57:11.023928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 107/219] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:10 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:11.128179 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:11.140160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-38141db6-7a3b-4952-a6cf-82b7c3719a5d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.337959 Sep 14 19:57:11.157769 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 113/220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:10 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:12.054047 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:12.054652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:12.074215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:12.088371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:12.089070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:12.090033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:12.090638 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:12.094469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:12.170216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:12.170833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:12.208210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:12.208732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:12.211813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:12.212574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:12.213035 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:12.213621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:12.534826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:12.555215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f823785d-d179-4eb3-8a4f-4de39b59141c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.496109 Sep 14 19:57:12.556175 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 108/221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:12 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:12.838112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:12.859625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0b26f270-68ff-47e5-bd25-86707a14ad3c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.696002 Sep 14 19:57:12.881933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 114/222] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:12 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:13.013080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-e3d69968-8825-47da-b0ad-2e4fd924bb3f req-e6574062-bfc1-4727-ac6b-354b0089bb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254fa332-f087-4923-a1f6-2975e927cc4a", "tag": "76215690-63a2-4250-9527-2472f8df9b4c"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:13.035084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e3d69968-8825-47da-b0ad-2e4fd924bb3f req-e6574062-bfc1-4727-ac6b-354b0089bb2d service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:13.036108 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e3d69968-8825-47da-b0ad-2e4fd924bb3f req-e6574062-bfc1-4727-ac6b-354b0089bb2d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:13.036692 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e3d69968-8825-47da-b0ad-2e4fd924bb3f req-e6574062-bfc1-4727-ac6b-354b0089bb2d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:13.052338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-e3d69968-8825-47da-b0ad-2e4fd924bb3f req-e6574062-bfc1-4727-ac6b-354b0089bb2d service nova] Creating event network-changed:76215690-63a2-4250-9527-2472f8df9b4c for instance 254fa332-f087-4923-a1f6-2975e927cc4a on hv-cinder-83976 Sep 14 19:57:13.075366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-e3d69968-8825-47da-b0ad-2e4fd924bb3f req-e6574062-bfc1-4727-ac6b-354b0089bb2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065864 Sep 14 19:57:13.077002 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 109/223] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:13.587298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:13.588070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:13.602404 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:13.603822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:13.605064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:13.606137 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:13.606641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:13.607067 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:13.804503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:13.813925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:13.817902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5217a1dd-7d09-4841-91fb-04feeda7686f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.242207 Sep 14 19:57:13.819098 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 115/224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:13 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:13.890453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:13.891616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:13.900645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:13.914881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:13.921465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:13.922192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:13.922971 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:13.923628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:13.924057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:14.204126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:14.222352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-233e3159-326c-440d-abfc-76fb014095ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.337441 Sep 14 19:57:14.223574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 110/225] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:13 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:14.843254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:14.845581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:14.856241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:14.857383 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:14.859644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:14.863915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:14.864879 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:14.866402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:15.086843 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:15.098572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-af6f09d8-3e68-4e21-b2fe-7f6bc113af0b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.258809 Sep 14 19:57:15.102461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 116/226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:14 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:15.248546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:15.250860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:15.270421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:15.270930 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:15.271379 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:15.272098 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:15.272555 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:15.272987 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:15.673821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:15.678901 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:15.701287 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-07d8efcf-0431-46d0-b149-a82484bf323e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.457020 Sep 14 19:57:15.701970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 111/227] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:15 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:16.128947 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:16.129990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:16.135429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:16.138119 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=6 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:16.148591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:16.150885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:16.153753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:16.155361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:16.156705 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:16.157198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:16.579129 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:16.592850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c8becd88-5172-4ace-b501-22b7ea76f8c0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.468324 Sep 14 19:57:16.617701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 117/228] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:16 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:16.730502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:16.731191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:16.754252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:16.754770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:16.755283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:16.756166 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:16.756737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:16.757290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:17.148094 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:17.157729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-684bfa03-ea2f-4c1b-99b3-645dd11c0ef0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.433236 Sep 14 19:57:17.158347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 112/229] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:16 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:17.620956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:17.623006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:17.638449 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:17.639294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:17.639960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:17.640876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:17.642854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:17.646500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:18.050285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:18.060072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b9c902ad-9b71-4753-bdbd-eb7e02af91db tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.443266 Sep 14 19:57:18.060876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 118/230] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:17 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:18.185538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:18.186851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:18.190515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=8 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:18.195028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:18.195573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:18.195952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:18.196934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:18.197456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:18.197906 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:18.394180 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:18.409678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7e3c6cdf-f532-484b-810f-44dc1f8e88d0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.226883 Sep 14 19:57:18.422383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:18 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:19.084905 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:19.085565 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:19.117179 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:19.123251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:19.124044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:19.125254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:19.125884 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:19.127200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:19.384908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:19.396005 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ba1bb52a-6d16-414f-8b39-376e986e8191 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.316089 Sep 14 19:57:19.399041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 119/232] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:19 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:19.435879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:19.437135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:19.450087 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:19.450960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:19.451765 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:19.452946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:19.453729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:19.454684 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:19.745666 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:19.762281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6006505d-16df-4190-bf22-40777b2912a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.331028 Sep 14 19:57:19.771289 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 114/233] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:19 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:19.820839 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6a922d24-1993-44f9-9aed-3fa7bdb027c1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: .version_select at 0x7f19e589bb80>, body: {"keypair": {"name": "tempest-keypair-1598543709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKlj5Rg0suMKU884fXbe8VKs8jJ6pAkdmkHWsLZiMdDWk+rpbYbYRB0p3xolWB0Klra/2m2PjIuZ/uysp2XJ9LnegXo/M40alYXOeuS/YCr6igVEkWzJt4VpbuU3MZFvg=="}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:19.858316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-6a922d24-1993-44f9-9aed-3fa7bdb027c1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:57:19.866575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-6a922d24-1993-44f9-9aed-3fa7bdb027c1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:57:20.006979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6a922d24-1993-44f9-9aed-3fa7bdb027c1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.549773 Sep 14 19:57:20.007878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 120/234] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 19:57:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:20.420551 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:20.421540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:20.428418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:20.429332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:20.429984 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:20.431085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:20.431599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:20.432188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:20.623265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:20.635923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c6b813f1-27c2-49a9-9322-bbbc4747f961 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.219253 Sep 14 19:57:20.649556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 115/235] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:20 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:20.796117 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:20.797408 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:20.816067 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:20.817594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:20.818584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:20.819665 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:20.820684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:20.821862 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:21.444448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:21.455906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-53f3f60d-3750-4074-bbb3-da3b8131b661 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.663739 Sep 14 19:57:21.457244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 121/236] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:20 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:21.501154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:21.501154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:21.501154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:21.501154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:21.501512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:21.502273 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:21.503272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:21.503693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:21.592425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4a899a51-317c-491c-b59f-4e24c1dbd919 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/ips" status: 200 len: 153 microversion: 2.20 time: 0.122427 Sep 14 19:57:21.609982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 116/237] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Sep 14 19:57:21 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/ips => generated 153 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:57:21.663228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:21.664090 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:21.668314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:21.681266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:21.681679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:21.689548 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:21.690470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:21.690979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:21.697698 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:21.999807 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:22.009533 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c05b0f6d-ea75-4957-b78d-b62bfa4ca06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.350826 Sep 14 19:57:22.010159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 122/238] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:21 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:22.484411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:22.485830 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:22.495015 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:22.495670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:22.496342 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:22.497265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:22.497980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:22.498630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:22.652312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:22.660708 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9e29fd26-70c2-4f0b-afa6-94357fe316a0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.180203 Sep 14 19:57:22.661301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 117/239] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:22 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:23.032468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:23.033643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:23.041512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:23.042448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:23.043275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:23.044805 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:23.045445 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:23.045891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:23.208168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:23.227785 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2cd6b984-b9a7-4594-8f90-f644df461529 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.199011 Sep 14 19:57:23.228370 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 123/240] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:23 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:23.692336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:23.693657 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:23.708895 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:23.708895 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:23.708895 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:23.708895 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:23.709330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:23.709330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:23.794028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-980550418", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdcbc0df-73f5-4094-bf95-288827ed92e6"}], "security_groups": [{"name": "tempest-securitygroup--1883198194"}], "key_name": "tempest-keypair-1598543709", "user_data": "}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:23.955328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:23.968123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-730d0fe3-1963-4efe-b074-38b4e081f85d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.280255 Sep 14 19:57:23.975643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] validate_networks() for [('fdcbc0df-73f5-4094-bf95-288827ed92e6', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:57:23.986703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 118/241] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:23 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:24.251999 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:24.252740 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:24.260960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:24.261722 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:24.262293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:24.263332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:24.263995 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:24.264621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:24.572547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:57:24.573609 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:57:24.574367 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:57:24.575086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:57:24.575692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:57:24.596815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:24.598314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:24.598922 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:24.603487 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:24.611706 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:24.611706 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:24.642500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:57:24.642500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:57:24.657951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:57:24.660844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:57:24.759007 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:24.767068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-221a2d68-945b-4345-b3c0-e57ad75f8988 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.519871 Sep 14 19:57:24.769366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 119/242] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:24 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:24.861418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a423100d-621c-4232-a125-07f1a599c636 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.078072 Sep 14 19:57:24.868899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 124/243] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:57:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 19:57:24.874136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fa5eef7a-9158-4b78-a442-1496806539b2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:24.874864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fa5eef7a-9158-4b78-a442-1496806539b2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:25.007373 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:25.007610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:25.010003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fa5eef7a-9158-4b78-a442-1496806539b2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:25.017778 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fa5eef7a-9158-4b78-a442-1496806539b2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1241 microversion: 2.1 time: 0.147465 Sep 14 19:57:25.022719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:25.023254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 120/244] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:24 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:25.023386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:25.023775 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:25.024519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:25.025258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:25.025741 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:25.258566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:25.268078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-71aa87c1-d8be-470d-9504-470a976858d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.268937 Sep 14 19:57:25.268678 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 125/245] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:24 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:25.793332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:25.794082 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:25.801495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:25.802003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:25.802439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:25.803121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:25.803572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:25.803999 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:25.964917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:25.972700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6667f879-00a1-486d-ad2c-c965db13cb19 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.183192 Sep 14 19:57:25.973252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 121/246] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:25 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:26.048500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4d1ff8ff-f28c-45cd-9698-0fa8879229de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:26.049156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4d1ff8ff-f28c-45cd-9698-0fa8879229de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:26.102994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4d1ff8ff-f28c-45cd-9698-0fa8879229de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:26.109791 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4d1ff8ff-f28c-45cd-9698-0fa8879229de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1241 microversion: 2.1 time: 0.065133 Sep 14 19:57:26.110413 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 126/247] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:26 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:26.292400 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:26.293084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:26.299079 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:26.300155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:26.300677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:26.301424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:26.301910 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:26.302399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:26.534433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:26.542171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-97963bdd-87c8-4de0-9df9-96ae117af573 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.253648 Sep 14 19:57:26.542725 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 122/248] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:26 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:26.995458 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:26.996063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:27.001973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.002451 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.002880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.003558 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.004023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.004421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.132952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:27.134522 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:27.142265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.142985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.144266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.145207 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.145863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.146504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.154869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:27.156870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-91c8a9d8-84b4-41c1-872b-f9992214fc4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.165200 Sep 14 19:57:27.170357 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 127/249] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:26 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:27.181021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:27.181871 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:27.198676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.199500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.200114 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.201188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.201837 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.202416 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.216460 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:27.226218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8eb26cb9-c645-4c65-b3ef-bd63e07bc70f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1245 microversion: 2.1 time: 0.096970 Sep 14 19:57:27.227151 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lazy-loading 'flavor' on Instance uuid 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:57:27.234310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 123/250] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:27 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:27.570831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:27.572125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:27.580706 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.582010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.582542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.583920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.584504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.584928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.717176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:27.726621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2072c456-2027-4334-956b-b1b314d8bb92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1520 microversion: 2.1 time: 0.163306 Sep 14 19:57:27.730639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 124/251] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:27 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:27.949107 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-006fbef5-b497-4a55-80f8-1c2d6e54b084 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/action" status: 202 len: 0 microversion: 2.20 time: 0.777257 Sep 14 19:57:27.949868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 128/252] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 19:57:27 2022] POST /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:57:27.958023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:27.958670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:27.964617 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.965099 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.965527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:27.966231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:27.966678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:27.967097 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.103163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:28.111371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:28.113336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:28.114537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2cf06725-7d9e-4e95-a110-d35cde2d4cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.160476 Sep 14 19:57:28.115088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 125/253] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:27 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:28.185264 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:28.186101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:28.193311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.197915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.197915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.197915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.197915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.198281 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.248989 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:28.249636 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:28.258833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.258833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.258833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.258833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.259277 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.259277 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.327447 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:28.336426 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f34f5954-af92-4de9-96d5-ff89103961e6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1237 microversion: 2.1 time: 0.091204 Sep 14 19:57:28.337585 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 126/254] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:28 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:28.352625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:28.360560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9db61c65-65c2-4740-899c-024339fd5e8c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.179623 Sep 14 19:57:28.361115 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 129/255] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:28 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:28.753473 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:28.754120 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:28.760071 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.760558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.760998 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.761685 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.762191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.762624 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.892994 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:28.901349 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a83ef4f1-42aa-4356-beca-91d4969980cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1500 microversion: 2.1 time: 0.151774 Sep 14 19:57:28.901938 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 127/256] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:28 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1500 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:28.923666 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:28.924270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:28.930110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.930590 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.931020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:28.931737 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:28.932184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:28.932605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:29.066019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:29.073930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-256a828b-6ca3-4272-afef-eafebcc77e2a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1516 microversion: 2.1 time: 0.154171 Sep 14 19:57:29.074477 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 130/257] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:28 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:29.140703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:29.141309 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:29.148027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:29.148511 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:29.148951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:29.149626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:29.150109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:29.150524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:29.291730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:29.300387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:29.301928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:29.303085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-10d5fba6-a101-437a-936c-f22f94cdbcca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.166573 Sep 14 19:57:29.303642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 128/258] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:29 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:29.360580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:29.361191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:29.367877 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:29.368466 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:29.368906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:29.369600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:29.370077 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:29.370504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:29.384886 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:29.385462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:29.392102 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:29.392606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:29.393047 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:29.393756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:29.394249 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:29.394718 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:29.534116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:29.536409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=100 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:29.542594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d0fbc7e3-1da6-4dc6-95ec-cc2fdd82b404 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.161739 Sep 14 19:57:29.543331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 129/259] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:29 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:29.570496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:29.578447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7f0c6c1a-6071-411b-a49f-438ed529370d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1293 microversion: 2.1 time: 0.221819 Sep 14 19:57:29.579008 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 131/260] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:29 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1293 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:30.331578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:30.332179 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:30.339390 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:30.339868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:30.340299 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:30.340975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:30.341426 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:30.341868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:30.476839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:30.484951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:30.486475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:30.487629 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-96aa5a42-fe14-4267-a3bc-9b17c53d30ca tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.160507 Sep 14 19:57:30.488221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 130/261] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:30 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:30.566682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:30.567288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:30.573629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:30.574148 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:30.574581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:30.575262 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:30.575713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:30.576132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:30.600924 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:30.601640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:30.607676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:30.608156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:30.608588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:30.609542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:30.610021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:30.610449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:30.672584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:30.680213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-93033252-5bde-406c-81aa-3181a63bafa3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1293 microversion: 2.1 time: 0.083573 Sep 14 19:57:30.680776 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 131/262] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:30 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:30.705702 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:30.714296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5de08c85-e69b-44a0-8d68-b8ed8dc83661 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.151990 Sep 14 19:57:30.714864 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 132/263] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:30 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:31.512538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:31.513141 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:31.520295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:31.520779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:31.521210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:31.521927 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:31.522427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:31.522853 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:31.659596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:31.668100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:31.680633 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:31.681927 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-612afc13-c633-41ab-b159-4bb9a1f3b889 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.173305 Sep 14 19:57:31.693455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 132/264] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:31 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:31.705231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:31.705942 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:31.711795 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:31.712291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:31.712714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:31.713405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:31.713937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:31.714415 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:31.718867 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:31.739174 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:31.739771 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:31.746424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:31.747197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:31.747695 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:31.748499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:31.749034 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:31.749528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:31.791654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:31.805216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4f91af9b-478c-4d92-8c8d-6a41075935f8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1301 microversion: 2.1 time: 0.103492 Sep 14 19:57:31.805216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 133/265] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:31 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1301 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:31.912974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:31.921190 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-58ec656e-717e-4ad6-bb79-309f0c9b60b4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.187214 Sep 14 19:57:31.922020 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 133/266] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:31 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:32.397782 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:32.400229 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:32.407003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:32.407491 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:32.407926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:32.408789 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:32.409420 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:32.410026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:32.437496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'flavor' on Instance uuid 6cb97b57-3da3-4808-904f-c0573b681648 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:57:32.688109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-8111e0af-ddd1-4a9e-ae6a-5ed7e9f257be req-1c8fe546-35db-42af-a7a5-90927190e5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254fa332-f087-4923-a1f6-2975e927cc4a", "name": "network-vif-plugged", "status": "completed", "tag": "76215690-63a2-4250-9527-2472f8df9b4c"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:32.697294 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-8111e0af-ddd1-4a9e-ae6a-5ed7e9f257be req-1c8fe546-35db-42af-a7a5-90927190e5fa service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:32.697779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-8111e0af-ddd1-4a9e-ae6a-5ed7e9f257be req-1c8fe546-35db-42af-a7a5-90927190e5fa service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:32.703752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-8111e0af-ddd1-4a9e-ae6a-5ed7e9f257be req-1c8fe546-35db-42af-a7a5-90927190e5fa service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:32.717825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-8111e0af-ddd1-4a9e-ae6a-5ed7e9f257be req-1c8fe546-35db-42af-a7a5-90927190e5fa service nova] Creating event network-vif-plugged:76215690-63a2-4250-9527-2472f8df9b4c for instance 254fa332-f087-4923-a1f6-2975e927cc4a on hv-cinder-83976 Sep 14 19:57:32.724036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-8111e0af-ddd1-4a9e-ae6a-5ed7e9f257be req-1c8fe546-35db-42af-a7a5-90927190e5fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044777 Sep 14 19:57:32.724947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 134/267] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:57:32.731048 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:32.731744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:32.754229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:32.754899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:32.755505 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:32.756632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:32.757240 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:32.757662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:32.855897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-510eebcc-f7ee-4762-9986-e281183542c2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648/action" status: 200 len: 32 microversion: 2.1 time: 0.462370 Sep 14 19:57:32.859687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 134/268] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:57:32 2022] POST /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 19:57:32.899630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:32.905278 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:32.919245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:32.919749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:32.920188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:32.921050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:32.921660 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:32.927295 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:32.968322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:32.982323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:32.984029 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:32.987487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-be42f793-afe3-4bb0-8b99-a1e292930172 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.260934 Sep 14 19:57:32.990527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 135/269] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:32 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:32.995534 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:32.999066 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:33.002443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:33.003668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:33.004324 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:33.005221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:33.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:33.006658 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:33.250199 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:33.259771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c0c24ed6-da08-4dca-a44f-7d63642d3dfc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.400256 Sep 14 19:57:33.260960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 135/270] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:32 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:33.278565 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:33.280567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:33.291495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:33.293819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:33.293819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:33.293819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:33.294535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:33.295159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:33.487784 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:33.493370 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:33.496230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-317b4ee3-d5d6-4ca3-b141-4e0f303287aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.504517 Sep 14 19:57:33.497033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 136/271] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:32 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:33.507897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d0823e46-0d5b-4291-b543-1350e3219af1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.245764 Sep 14 19:57:33.508956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 136/272] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:33 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:33.885736 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-2381c593-a310-4599-b2de-2b82c8007a65 req-6ec09ff4-401d-4dc7-8ed9-35e89ba926e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1639318a-4654-444a-9f8b-34640c1cdde6", "tag": "cdd586f3-f977-486d-b725-4d00c58613e2"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:33.896431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2381c593-a310-4599-b2de-2b82c8007a65 req-6ec09ff4-401d-4dc7-8ed9-35e89ba926e3 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:33.896921 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2381c593-a310-4599-b2de-2b82c8007a65 req-6ec09ff4-401d-4dc7-8ed9-35e89ba926e3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:33.897350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2381c593-a310-4599-b2de-2b82c8007a65 req-6ec09ff4-401d-4dc7-8ed9-35e89ba926e3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:33.910077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-2381c593-a310-4599-b2de-2b82c8007a65 req-6ec09ff4-401d-4dc7-8ed9-35e89ba926e3 service nova] Creating event network-changed:cdd586f3-f977-486d-b725-4d00c58613e2 for instance 1639318a-4654-444a-9f8b-34640c1cdde6 on hv-cinder-83976 Sep 14 19:57:33.915456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-2381c593-a310-4599-b2de-2b82c8007a65 req-6ec09ff4-401d-4dc7-8ed9-35e89ba926e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Sep 14 19:57:33.916236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 137/273] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:34.021107 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:34.021714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:34.027607 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.028146 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.028544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.029220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.029669 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.030114 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.162274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:34.170257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:34.171703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:34.172845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9b91fb5a-82a6-4a8e-aeec-263afac959fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.156269 Sep 14 19:57:34.173381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 137/274] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:34 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:34.284799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:34.285454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:34.291415 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.291893 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.292323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.293003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.293459 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.293895 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.421544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:34.429419 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9fe4b720-184f-404e-b75e-bce75b69fb21 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.148877 Sep 14 19:57:34.430008 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 138/275] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:34 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:34.521101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:34.521723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:34.527999 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.528353 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.528796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.529495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.529980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.530411 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.532309 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:34.532952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:34.539107 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.539581 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.540009 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.540711 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:34.541183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:34.541597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:34.616898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:34.664593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:34.670772 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:34.672368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-de8204f6-85a2-443d-86da-b817d99c9390 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.155776 Sep 14 19:57:34.672940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 138/276] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:34 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:34.679061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4cbf3478-8e30-4766-812f-51b98321da6c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.150530 Sep 14 19:57:34.679625 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 139/277] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:34 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:35.198323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:35.198937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:35.205514 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.206782 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.212149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.212149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.212149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.212149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.335358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:35.343558 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:35.345090 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:35.346252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5a25578c-6427-4f8d-b4d5-f96fcd030a99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.152161 Sep 14 19:57:35.346835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 139/278] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:35 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:35.452944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:35.453483 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:35.455939 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:35.460725 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.461200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.461642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.462345 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.462798 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.463211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.589001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:35.596835 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-752e527e-bd1e-4c55-9ed2-15f74ba29d18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.147934 Sep 14 19:57:35.597393 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 140/279] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:35 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:35.695072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:35.695711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:35.701958 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:35.702090 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.702507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.702648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:35.703004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.703638 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.704093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.704519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.708557 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.709036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.709471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.710171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:35.710618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:35.711037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:35.835248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:35.837714 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:35.843044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-897b31e1-91df-40c0-bc43-3826cb13f410 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.151855 Sep 14 19:57:35.843617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 140/280] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:35 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:35.845521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-014143b3-1745-4bb0-bba9-cbdd0d4f5471 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.147212 Sep 14 19:57:35.846082 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 141/281] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:35 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:36.372713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:36.373507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:36.375511 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=12 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:36.381171 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.381662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.382336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:36.382801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.383286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.383807 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:36.619649 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:36.620264 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:36.626696 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.627183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.627618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:36.628839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.629291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.631980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:36.644103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:36.652304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:36.653994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:36.655153 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bf79bf54-b258-4524-8836-996c4f0523f6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.286337 Sep 14 19:57:36.655747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 141/282] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:36 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:36.757959 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:36.765703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4c2fc769-6766-48b6-8d95-b9719f34ddbc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.149998 Sep 14 19:57:36.766332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 142/283] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:36 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:36.867668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:36.868306 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:36.869162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:36.869770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:36.874920 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.875651 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.875954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.876068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:36.876430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.876860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:36.876975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.877450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.877559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:36.878591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:36.878713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:36.879016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:37.110330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:37.110330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-33cb20d9-be85-4b94-a61f-94ef452efd9b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1357 microversion: 2.1 time: 0.238197 Sep 14 19:57:37.110330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 143/284] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:36 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:37.154316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:37.163256 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e1de3785-17a0-4abf-aac8-2f2bcf4d1c1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.299509 Sep 14 19:57:37.179388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 142/285] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:36 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:37.519186 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:37.519684 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:37.525539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:37.526056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:37.526493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:37.527181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:37.527638 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:37.528066 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:37.553129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a24d5bc2-07f5-41e7-9afb-d6c8156e707e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/ips" status: 200 len: 146 microversion: 2.1 time: 0.038280 Sep 14 19:57:37.553694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 144/286] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 19:57:37 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:57:37.680519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:37.681209 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:37.687158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:37.687647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:37.688086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:37.688815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:37.689269 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:37.689693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:37.789543 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:37.790289 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:37.796795 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:37.797279 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:37.797712 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:37.798427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:37.798907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:37.799327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:37.819566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:37.828010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:37.829519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:37.830701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ac42b081-f733-4d46-a0db-40b96784d83a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.154134 Sep 14 19:57:37.831973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 143/287] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:37 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:37.953666 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:37.964793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1586ba82-a137-4d4c-ab2c-94cb7a40f1f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.179230 Sep 14 19:57:37.965614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 145/288] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:37 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:38.127679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:38.129151 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:38.135412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.135957 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.136322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.137590 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.138262 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.139343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.191596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:38.192556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:38.200406 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.200902 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.201416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.202467 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.202922 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.203586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.315079 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:38.323806 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4bfd5840-01a8-44bf-839f-65217732ffb6 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1547 microversion: 2.1 time: 0.200105 Sep 14 19:57:38.324436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 144/289] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:38 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1547 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:38.340785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:38.347468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:38.348294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:38.350679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a0f22179-afeb-4711-93a8-285027bf7616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.163838 Sep 14 19:57:38.351247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 146/290] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:38 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:38.354327 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.354811 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.355245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.355934 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.356391 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.356929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.644296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:38.652442 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a4e3a584-904d-41cf-a951-7c51d113761a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1547 microversion: 2.1 time: 0.308773 Sep 14 19:57:38.653021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 145/291] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:38 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1547 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:38.675822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:38.681588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:38.682133 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Searching by: {'deleted': False, 'project_id': '11fae649642b4703b649d02268bdb4eb'} {{(pid=132862) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 19:57:38.688982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.689474 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.690131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.690912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.691647 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.692063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.793474 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.multi_cell_list [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 19:57:38.850320 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=100 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:38.865217 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:38.865910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:38.871967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.872451 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.872886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.873573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.874051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.874553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.895432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-21190927-b8de-486d-8e26-a25b74e1d1dd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.224187 Sep 14 19:57:38.896056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 147/292] 10.222.0.42 () {58 vars in 1125 bytes} [Wed Sep 14 19:57:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:38.908331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:38.908949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:38.916058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.916600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.920085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:38.920085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:38.920085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:38.920085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:39.035908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:39.044911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:39.046766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:39.047945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-052342c7-c859-4515-aade-8e53ee66cb0d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.187413 Sep 14 19:57:39.048554 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 146/293] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:38 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:57:39.053175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:39.054225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:39.060808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:39.061528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:39.062172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:39.063941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:39.063941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:39.063941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:39.077383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:39.085511 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a021e080-8799-46ed-bec2-523a2ab2bfbf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1547 microversion: 2.1 time: 0.181209 Sep 14 19:57:39.086140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 148/294] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:38 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1547 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:39.213943 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:39.217496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:39.225076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-39af3d44-f783-438e-89a0-f359e8ab9031 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.175345 Sep 14 19:57:39.227676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 147/295] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:39 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:39.377303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:39.378819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:39.385310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:39.386594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:39.394756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:39.395497 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:39.396431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:39.396853 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:39.577253 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:39.593261 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-dbe13849-b711-4e89-a7e5-817b4a5256aa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.221128 Sep 14 19:57:39.593866 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 149/296] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:39 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:40.074990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:40.075602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:40.084917 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:40.085426 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:40.086106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:40.087298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:40.087760 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:40.088237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:40.250743 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:40.252113 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:40.263504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:40.263504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:40.263504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:40.263504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:40.263848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:40.263953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:40.263953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:40.279303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:40.280979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:40.282494 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-18bed960-6f18-4fa4-8317-1c7498dfe1c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.212920 Sep 14 19:57:40.283535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 148/297] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:40 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:57:40.441783 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:40.456143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0cd65add-3410-4ecf-a1b3-3039c26651d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.209017 Sep 14 19:57:40.460337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:40 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:40.616341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:40.616950 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:40.622902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:40.623385 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:40.623822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:40.624506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:40.624958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:40.625383 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:40.756616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:40.764450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2a6cba5f-5232-443f-bdf4-90c2d4205077 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.151927 Sep 14 19:57:40.765048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 149/299] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:40 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:41.082190 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ae48e5b-39cf-4f61-862c-1733f61aa063"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:41.084567 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:41.090500 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.093372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.093372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:41.093372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.093372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.093764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:41.311015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:41.312665 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:41.320847 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.321707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.322626 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:41.323512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.324143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.324746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:41.575170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:41.592812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:41.601246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:41.613643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-108d5e0f-e98e-4146-9271-c3c7a2dec42e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.295445 Sep 14 19:57:41.613643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 150/300] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:41 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:41.613643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:41.613643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:41.623629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.626440 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.627085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:41.628507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.628969 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.629394 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:41.850967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:41.859466 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ce7b16e1-212b-4331-959b-258091f2b066 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.255372 Sep 14 19:57:41.860035 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 151/301] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:41 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:41.868640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:41.870063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:41.877061 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.877763 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.878230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:41.879082 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:41.879687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:41.880381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:42.086005 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:42.093973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-253fe608-a338-47e4-a41a-3d72160d1f99 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.232739 Sep 14 19:57:42.094520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 152/302] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:41 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:42.452479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7877e80d-35f0-410c-95f8-8b88c3db07f8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.374657 Sep 14 19:57:42.453319 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 151/303] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:57:41 2022] POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-volume_attachments => generated 194 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:42.634821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:42.635506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:42.643149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:42.644388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:42.645081 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:42.646001 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:42.646670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:42.647305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:42.653601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3b77df1-3f56-46be-a7d5-2144018e7d70"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:42.656349 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:42.668513 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:42.668938 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:42.680091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:42.680888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:42.681367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:42.681823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:42.832069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:42.844899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:42.844899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:42.844899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7241ea24-5cda-4b6b-8a05-a337b7bbcf1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.212722 Sep 14 19:57:42.845276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 153/304] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:42 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:42.891701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:42.893762 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:42.900314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:42.900908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:42.901400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:42.902238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:42.902706 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:42.903612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:43.062197 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:43.070663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0c281c1f-3fa0-4fc5-892b-c439069da4b9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.185727 Sep 14 19:57:43.071242 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 154/305] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:42 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:43.121418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:43.121418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:43.124666 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:43.125146 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:43.125581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:43.126284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:43.126733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:43.127153 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:43.265933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:43.273598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4af3326f-edaa-4c5f-a0b9-6c3b7ac70ff3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.159502 Sep 14 19:57:43.274179 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 155/306] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:43 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:43.408642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-90dd9dd9-7b8a-4f69-b3d8-3986c20bf887 req-364e2a20-5b2a-483a-bf7b-32aa3a735656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1639318a-4654-444a-9f8b-34640c1cdde6", "name": "network-vif-plugged", "status": "completed", "tag": "cdd586f3-f977-486d-b725-4d00c58613e2"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:43.423951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-90dd9dd9-7b8a-4f69-b3d8-3986c20bf887 req-364e2a20-5b2a-483a-bf7b-32aa3a735656 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:43.423951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-90dd9dd9-7b8a-4f69-b3d8-3986c20bf887 req-364e2a20-5b2a-483a-bf7b-32aa3a735656 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:43.423951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-90dd9dd9-7b8a-4f69-b3d8-3986c20bf887 req-364e2a20-5b2a-483a-bf7b-32aa3a735656 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:43.435118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-90dd9dd9-7b8a-4f69-b3d8-3986c20bf887 req-364e2a20-5b2a-483a-bf7b-32aa3a735656 service nova] Creating event network-vif-plugged:cdd586f3-f977-486d-b725-4d00c58613e2 for instance 1639318a-4654-444a-9f8b-34640c1cdde6 on hv-cinder-83976 Sep 14 19:57:43.440981 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-90dd9dd9-7b8a-4f69-b3d8-3986c20bf887 req-364e2a20-5b2a-483a-bf7b-32aa3a735656 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Sep 14 19:57:43.441566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 156/307] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:43.873649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:43.874395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:43.887025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:43.887025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:43.887025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:43.887025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:43.887535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:43.887535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:43.980900 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5fb4bfd7-0da4-461c-ade8-82db6c93764a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.331342 Sep 14 19:57:43.982256 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 152/308] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:57:42 2022] POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 194 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:44.033215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:44.041759 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:44.043216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:44.044389 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2dbf4103-fa65-4d5b-8153-d3844fc096c1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.176777 Sep 14 19:57:44.047888 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 157/309] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:43 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:44.094738 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:44.095434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:44.102444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:44.102926 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:44.103362 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:44.104049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:44.104499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:44.104923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:44.250643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:44.258196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b2d4839c-0d0f-4769-af23-ffa9ff5374b6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.168232 Sep 14 19:57:44.258754 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 153/310] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:44 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:44.298907 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:44.299845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:44.306541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:44.307206 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:44.307711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:44.308346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:44.308796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:44.309221 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:44.441610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:44.450328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1034a50a-7d13-4ce0-8662-33d7973a3f9a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.156133 Sep 14 19:57:44.451204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 158/311] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:44 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:45.157630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:45.157630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:45.157630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:45.157630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:45.158779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:45.158779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:45.158779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:45.158779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:45.217146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:45.225774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:45.227490 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:45.228874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9d79dc55-f238-4544-b6f7-47775b478f48 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1745 microversion: 2.20 time: 0.161638 Sep 14 19:57:45.229462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 154/312] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:45 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:57:45.331580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:45.331580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:45.331580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:45.331580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:45.332467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:45.332467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:45.332467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:45.332467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:45.430681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:45.439139 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-162ba412-748a-4036-b6f5-400f9303eb7e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.160166 Sep 14 19:57:45.439139 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 159/313] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:45 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:45.476443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:45.477048 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:45.482992 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:45.487433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:45.487433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:45.487433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:45.487433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:45.487882 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:45.627094 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:45.636553 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9108b8e0-fc50-4486-83a3-333e15b35dac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.163998 Sep 14 19:57:45.637146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 155/314] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:45 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:46.256182 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:46.256803 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:46.263438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:46.263921 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:46.264355 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:46.265155 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:46.265648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:46.266111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:46.408576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:46.417504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:46.419041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:46.420232 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f1eb6301-ea23-46ed-a5e2-f05982a0d494 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1745 microversion: 2.20 time: 0.168509 Sep 14 19:57:46.420917 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 160/315] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:46 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:46.468458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:46.469066 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:46.477735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:46.478259 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:46.478745 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:46.479479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:46.480090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:46.480730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:46.616454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:46.624127 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-589c59d6-9f3b-4836-92ca-c739e747afd2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.159575 Sep 14 19:57:46.624686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 156/316] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:46 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:46.660390 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:46.660996 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:46.666876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:46.667360 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:46.667792 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:46.668476 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:46.668929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:46.669376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:46.796738 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:46.804940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a84367c6-f35d-4966-8aba-269fbed8c931 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.148319 Sep 14 19:57:46.805532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 161/317] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:46 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:47.445871 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:47.446566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:47.454583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:47.455813 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:47.456949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:47.457719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:47.458286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:47.458773 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:47.593774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:47.602639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:47.604079 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:47.605342 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c80e5443-c1a0-4ea8-b333-96631c184909 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1745 microversion: 2.20 time: 0.163293 Sep 14 19:57:47.606154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 157/318] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:47 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:47.649095 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:47.650237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:47.656889 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:47.657622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:47.658066 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:47.658927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:47.659370 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:47.659850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:47.795882 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:47.804306 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e4717499-7b73-491b-a8dd-482d96483dcd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.160120 Sep 14 19:57:47.804867 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 162/319] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:47 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:47.829247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:47.829907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:47.836539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:47.837039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:47.837481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:47.838189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:47.838637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:47.839060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:48.000826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:48.000826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-972067e0-831e-41ae-8b0f-5b4d2416e275 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.169091 Sep 14 19:57:48.000826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 158/320] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:47 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:48.631368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:48.631980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:48.633979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:48.639045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:48.639532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:48.639964 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:48.644194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:48.644699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:48.645145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:48.792821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:48.804682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:48.809569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:48.810994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d7729c7d-464f-48b2-bd31-904aa0c85b81 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1745 microversion: 2.20 time: 0.183591 Sep 14 19:57:48.821986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 163/321] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:48 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:48.828643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:48.829210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:48.832479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:48.836831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=100 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:48.838212 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:48.838704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:48.839301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:48.839932 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:48.840387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:48.840845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:48.991159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:48.998822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6a13391e-9446-4f0d-9f34-a68349f7330b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1367 microversion: 2.1 time: 0.174121 Sep 14 19:57:48.999385 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 159/322] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:48 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:49.019202 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:49.024436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:49.025730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:49.026248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:49.026685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:49.027371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:49.027826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:49.028250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:49.228690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:49.236583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-12ceb95f-239d-4f49-8644-2ec638346a4c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.221734 Sep 14 19:57:49.237230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 164/323] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:49 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:49.840083 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:49.840733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:49.848623 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:49.849110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:49.849639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:49.850394 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:49.850887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:49.851393 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:49.989829 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:49.998350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:49.999792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:50.001039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3ebbd752-fd7c-451b-9d7f-8651bf0f3d88 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.165397 Sep 14 19:57:50.001586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 160/324] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:49 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:50.024189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:50.024825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:50.031213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:50.034046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:50.034046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:50.034046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:50.034046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:50.035103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:50.038129 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:50.228993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:50.233371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4ba4328d-6bc3-49cb-8193-153110bf1355 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1556 microversion: 2.1 time: 0.214205 Sep 14 19:57:50.233965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 165/325] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:50 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:50.256560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:50.257064 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:50.261366 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:50.262032 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:50.263576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:50.264137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:50.264569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:50.265255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:50.265709 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:50.266299 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:50.267677 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:50.272031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:50.272031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:50.272031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:50.272031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:50.272374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:50.346156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-eb3ffae8-ed55-466a-b61f-c3aaf0f9e5d8 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093506 Sep 14 19:57:50.354470 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 161/326] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 19:57:50 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:50.418462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:50.428250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4c5144e9-b6d0-431e-b96d-9808fe2b8c45 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.170398 Sep 14 19:57:50.442310 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 166/327] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:50 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:51.032909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:51.032909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:51.037369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:51.037880 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:51.038362 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:51.039009 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:51.039480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:51.039887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:51.043936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:51.221142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:51.231743 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:51.233182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:51.234590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8ce5aa41-fb93-41cf-b631-cb6f2e2f32c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.208293 Sep 14 19:57:51.235151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 162/328] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:51 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:51.459808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:51.460589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:51.476475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-7b085862-b7b2-411b-a97d-4121e060350e req-a5754fdb-d16f-4ac0-b97c-c656c1f2ebf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a", "name": "network-vif-plugged", "status": "completed", "tag": "127c779f-5b8f-4922-8168-11cb82065f9b"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:51.476946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:51.477982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:51.479268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:51.481185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:51.481734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:51.485479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:51.495632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-7b085862-b7b2-411b-a97d-4121e060350e req-a5754fdb-d16f-4ac0-b97c-c656c1f2ebf1 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:51.497480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-7b085862-b7b2-411b-a97d-4121e060350e req-a5754fdb-d16f-4ac0-b97c-c656c1f2ebf1 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:51.497480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-7b085862-b7b2-411b-a97d-4121e060350e req-a5754fdb-d16f-4ac0-b97c-c656c1f2ebf1 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:51.511221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-7b085862-b7b2-411b-a97d-4121e060350e req-a5754fdb-d16f-4ac0-b97c-c656c1f2ebf1 service nova] Creating event network-vif-plugged:127c779f-5b8f-4922-8168-11cb82065f9b for instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a on hv-cinder-83976 Sep 14 19:57:51.517471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-7b085862-b7b2-411b-a97d-4121e060350e req-a5754fdb-d16f-4ac0-b97c-c656c1f2ebf1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049466 Sep 14 19:57:51.518550 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 163/329] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:51.669588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:51.679593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f713302c-c877-4428-86a6-654f481ca1d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.230424 Sep 14 19:57:51.687578 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 167/330] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:51 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:51.886860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-77198d41-1b13-427c-a52e-9e81d9e4227a req-6ded2ed8-22e7-4151-87fe-5f4b1eea5036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1639318a-4654-444a-9f8b-34640c1cdde6", "tag": "cdd586f3-f977-486d-b725-4d00c58613e2"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:51.896846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-77198d41-1b13-427c-a52e-9e81d9e4227a req-6ded2ed8-22e7-4151-87fe-5f4b1eea5036 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:51.899652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-77198d41-1b13-427c-a52e-9e81d9e4227a req-6ded2ed8-22e7-4151-87fe-5f4b1eea5036 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:51.899652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-77198d41-1b13-427c-a52e-9e81d9e4227a req-6ded2ed8-22e7-4151-87fe-5f4b1eea5036 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:51.908516 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-77198d41-1b13-427c-a52e-9e81d9e4227a req-6ded2ed8-22e7-4151-87fe-5f4b1eea5036 service nova] Creating event network-changed:cdd586f3-f977-486d-b725-4d00c58613e2 for instance 1639318a-4654-444a-9f8b-34640c1cdde6 on hv-cinder-83976 Sep 14 19:57:51.913396 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-77198d41-1b13-427c-a52e-9e81d9e4227a req-6ded2ed8-22e7-4151-87fe-5f4b1eea5036 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030767 Sep 14 19:57:51.914194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 164/331] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:57:52.264539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:52.265150 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:52.271234 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:52.271779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:52.279788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:52.279788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:52.279788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:52.279788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:52.418583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:52.428898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:52.430317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:52.431490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c91b92e7-a6f0-42f5-b032-1900a80a55ea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.170967 Sep 14 19:57:52.432048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 168/332] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:52 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:52.714537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:52.715252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:52.722951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:52.723441 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:52.723876 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:52.724577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:52.725029 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:52.725460 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:52.907968 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:52.916520 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bffe7e2c-3149-4096-aca5-2cb37d0a71c4 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.215512 Sep 14 19:57:52.933241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 165/333] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:52 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:53.457143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:53.457876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:53.465424 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:53.466111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:53.473112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:53.473112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:53.473112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:53.473112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:53.643359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:53.653885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:53.656923 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:53.658737 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-83ad727a-c8cc-431e-a473-83ad2e9da164 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.205761 Sep 14 19:57:53.660088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 169/334] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:53 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:53.833903 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1120172694", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "networks": [{"uuid": "5d93a901-9188-457f-993b-66c28d3f5aed"}]}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:53.926647 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] validate_networks() for [('5d93a901-9188-457f-993b-66c28d3f5aed', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:57:53.940740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:53.942320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:53.955723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:53.956792 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:53.957841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:53.959211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:53.961369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:53.962071 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:54.180575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:54.189527 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-79ffb1f2-9039-4855-b3c8-2f000d360616 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.252890 Sep 14 19:57:54.190829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 170/335] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:53 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:54.210215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-22701b4b-fd7c-4ba2-b284-17fe55a10cea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:57:54.217096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-22701b4b-fd7c-4ba2-b284-17fe55a10cea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:54.218041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-22701b4b-fd7c-4ba2-b284-17fe55a10cea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:54.218648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-22701b4b-fd7c-4ba2-b284-17fe55a10cea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:54.289538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-22701b4b-fd7c-4ba2-b284-17fe55a10cea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Going to try to stop instance {{(pid=132861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 19:57:54.464073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:57:54.464807 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:57:54.465458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:57:54.465955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:57:54.466372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:57:54.479131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:54.479632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:54.480181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:54.480912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:54.481366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:54.481793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:54.500857 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Getting quotas for project bb2e9dd680194d6e9b861fed73188ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:57:54.510820 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Getting quotas for user a66d0ec3a156469980551f9bc9034d4e and project bb2e9dd680194d6e9b861fed73188ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:57:54.520487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:57:54.522955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:57:54.598178 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-22701b4b-fd7c-4ba2-b284-17fe55a10cea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action" status: 202 len: 0 microversion: 2.1 time: 0.405525 Sep 14 19:57:54.600359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 171/336] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:57:54 2022] POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:57:54.610093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:54.611536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:54.621313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:54.622197 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:54.622818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:54.623686 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:54.624288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:54.624974 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:54.858079 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:54.867061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7137e2c1-14da-42f4-a395-65f44f68a4ac tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038382 Sep 14 19:57:54.868407 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-435ac26a-ce42-4cce-9339-c232caf6a83f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.262463 Sep 14 19:57:54.869703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 172/337] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:54 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:54.876606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 166/338] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:57:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:57:54.887906 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-97f03f0a-a24b-4877-8850-091854a2e2d8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:54.896819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:54.896819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:54.897469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-97f03f0a-a24b-4877-8850-091854a2e2d8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:54.953771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:54.958073 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:54.959849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:54.961581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:54.971547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:54.978381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:55.038172 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-97f03f0a-a24b-4877-8850-091854a2e2d8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:55.051805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-97f03f0a-a24b-4877-8850-091854a2e2d8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1219 microversion: 2.1 time: 0.166717 Sep 14 19:57:55.053556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 167/339] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:54 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:55.214854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:55.215809 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:55.226444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:55.227845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:55.230283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:55.234825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:55.235215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:55.235749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:55.236292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:55.249084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:55.251190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:55.252460 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f70acf32-a7a1-4300-a65b-a7d91800de7a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.381487 Sep 14 19:57:55.253605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 173/340] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:54 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:55.416681 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:55.429321 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-349a9300-9167-44ff-8595-d769057426e0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.218675 Sep 14 19:57:55.430193 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 168/341] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:55 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:55.893039 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:55.893730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:55.900345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:55.900838 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:55.901274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:55.902414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:55.902868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:55.903451 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:56.073619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:56.073619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5139d5e5-fa0a-42be-83a4-da369c5d4a62 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.181447 Sep 14 19:57:56.075800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b0860b1f-813a-4f51-9fb9-b163d556a206 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:56.076408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b0860b1f-813a-4f51-9fb9-b163d556a206 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:56.098419 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 174/342] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:55 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:56.149896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b0860b1f-813a-4f51-9fb9-b163d556a206 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:56.158625 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b0860b1f-813a-4f51-9fb9-b163d556a206 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1219 microversion: 2.1 time: 0.087140 Sep 14 19:57:56.160228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 169/343] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:56 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:56.280716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:56.281638 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:56.288935 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:56.289741 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:56.290366 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:56.291227 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:56.292298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:56.292962 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:56.452012 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:56.454351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:56.455077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:56.463794 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:56.465831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:56.466488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:56.467478 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1c660bc5-3361-4987-8d5d-01a18087085f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.192297 Sep 14 19:57:56.468075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:56.468732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 175/344] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:56 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:56.469259 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:56.470718 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:56.473045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:56.476056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:56.643782 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:56.648389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2f4b61ba-8273-4abf-975a-2dc2133ee892 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.199315 Sep 14 19:57:56.666031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 170/345] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:56 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:57.103952 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:57.104541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:57.110513 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:57.110993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:57.111427 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:57.112105 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:57.113097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:57.113525 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:57.182704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2af43134-967c-4c3f-81b4-11592ae86611 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:57.183275 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2af43134-967c-4c3f-81b4-11592ae86611 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:57.239864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2af43134-967c-4c3f-81b4-11592ae86611 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:57.246933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2af43134-967c-4c3f-81b4-11592ae86611 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1219 microversion: 2.1 time: 0.068253 Sep 14 19:57:57.262945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:57.263280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ba4d1621-f405-4901-a1c4-7bbc52acc726 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.162894 Sep 14 19:57:57.263668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 171/346] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:57 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:57.264018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 176/347] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:57 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:57.498656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:57.499187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:57.505686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:57.506331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:57.506770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:57.507454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:57.507904 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:57.508326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:57.635774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:57.644946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:57.646825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:57.647976 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-871c1312-4097-4afd-932c-ad85ddc2500f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.153345 Sep 14 19:57:57.648584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 172/348] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:57 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:57.672595 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:57.673565 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:57.684941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:57.685450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:57.686109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:57.686835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:57.687289 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:57.687721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:57.872366 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:57.881574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0113bc00-7328-43f0-b0db-3cf3b6caf37e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.212836 Sep 14 19:57:57.882647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 177/349] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:57 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:58.270761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:58.271399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:58.278796 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.279589 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.280043 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:58.280998 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.281475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.282100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:58.287544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:58.288170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:58.297149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.299365 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.299365 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:58.299365 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.299651 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.299925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:58.363376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:58.371156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7786ebcc-70a5-4529-ac8c-603f878508c2 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1223 microversion: 2.1 time: 0.105465 Sep 14 19:57:58.372480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 173/350] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:58 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:58.477825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:58.487293 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-36457111-ce1f-4df4-8796-f4f59077251f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.204563 Sep 14 19:57:58.504165 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 178/351] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:58 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:57:58.677177 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:58.677788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:58.684562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.685288 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.685736 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:58.686514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.687250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.687739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:58.848153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:58.857521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:58.859389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:58.860806 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-88eeb30d-ae1a-4e6a-a4c6-30bba86016dc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.189491 Sep 14 19:57:58.861882 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 174/352] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:58 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:57:58.906668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:58.923037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:58.923037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.923037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.923037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:58.923452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:58.923452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:58.923452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:59.087844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:59.096286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5d8fe486-abaa-404b-9038-8583cf0bfa64 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.194299 Sep 14 19:57:59.097836 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 179/353] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:58 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:59.397744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:59.398615 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:59.414359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:59.414359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:59.414359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:59.414359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:59.414670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:59.414670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:59.490547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:59.490547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a6c60a42-cddd-4119-a1b4-0492c437f243 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1215 microversion: 2.1 time: 0.092434 Sep 14 19:57:59.490547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 175/354] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:59 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:59.515870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:59.516662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:59.524022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:59.524676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:59.525174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:59.525954 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:59.526475 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:59.526983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:59.672044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:57:59.676045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:57:59.681384 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f58f93bc-55c6-484e-9f1c-2efa6739ffb6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.170570 Sep 14 19:57:59.688195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 180/355] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:57:59 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:57:59.888283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:57:59.889138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:57:59.895587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:59.896115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:59.896551 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:57:59.897242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:57:59.897702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:57:59.898378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:00.043084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:00.052587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:00.054330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:00.055596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ca5e7e51-4f8f-4fc1-acfc-357d29ec91f7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.171191 Sep 14 19:58:00.056160 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 176/356] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:57:59 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:00.126374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:00.127069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:00.135111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:00.135739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:00.136343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:00.137212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:00.137727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:00.138316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:00.282543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:00.296794 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-13103e2e-4774-4551-91da-652943296da1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.176103 Sep 14 19:58:00.313911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 181/357] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:00 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:00.511560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:00.513880 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:00.522793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:00.523606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:00.526004 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:00.526004 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:00.526425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:00.526700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:00.606884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:00.617944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-654d73af-6490-4899-937f-a3d2f2c8e528 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1215 microversion: 2.1 time: 0.110084 Sep 14 19:58:00.618534 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 177/358] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:00 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:00.707610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:00.708166 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:00.716377 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:00.717101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:00.717761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:00.718726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:00.719286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:00.719933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:00.858876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:00.867635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7738a99b-01b8-415d-bd4c-5345ad7fd4a0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.164125 Sep 14 19:58:00.868224 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 182/359] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:00 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:01.081575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:01.082216 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:01.088159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.089440 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.089440 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:01.089760 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.090233 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.090678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:01.238219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:01.246687 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:01.248500 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:01.249732 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-30f44af6-6b56-4b22-aed2-5c5046b58140 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.172091 Sep 14 19:58:01.271326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 178/360] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:01 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:01.323387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:01.324344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:01.334297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.334711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.335145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:01.335848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.336297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.336724 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:01.524331 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:01.536991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4af6d6bb-bec0-42fb-92ae-3fbb6654f2d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.217934 Sep 14 19:58:01.537687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 183/361] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:01 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:01.643026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:01.643809 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:01.650599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.651325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.651968 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:01.652755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.653350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.654139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:01.735392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:01.744286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2672bcbb-dd5f-4d53-ab86-9111db456c86 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1215 microversion: 2.1 time: 0.105223 Sep 14 19:58:01.745272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 179/362] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:01 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:01.893132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:01.895336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:01.903463 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.903956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.904594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:01.905466 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:01.906104 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:01.906766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:02.078624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:02.088899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f71bb75e-4905-4d77-acc9-ca28f5214d07 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.200562 Sep 14 19:58:02.089680 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 184/363] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:01 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:02.277456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:02.278559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:02.285140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:02.285819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:02.286381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:02.287199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:02.287755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:02.288266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:02.427917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:02.446003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:02.447513 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:02.448913 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-47e72870-ec90-4d89-ba56-a846a4f3dd66 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.176244 Sep 14 19:58:02.451309 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 180/364] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:02 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:02.560751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:02.565341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:02.567767 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:02.568255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:02.568704 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:02.569514 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:02.569999 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:02.570428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:02.723504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:02.735526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e708904f-2819-49f5-bb6f-a54157053c0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.178883 Sep 14 19:58:02.736096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 185/365] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:02 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:02.770086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:02.771702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:02.782479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:02.783697 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:02.784144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:02.784877 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:02.785335 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:02.785763 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:02.857244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:02.866612 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c55d7e21-bf37-43a2-be67-ceb65e0e7530 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1215 microversion: 2.1 time: 0.101295 Sep 14 19:58:02.867193 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 181/366] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:02 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:03.117854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:03.118504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:03.127832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.131703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.132542 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.134629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.135314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.135531 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.302317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:03.311178 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-120bfee6-db50-4163-835c-a08113d6b612 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.202364 Sep 14 19:58:03.312148 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 186/367] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:03 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:03.483701 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:03.484263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:03.491160 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.491637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.492099 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.492802 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.493528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.493912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.679861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:03.695512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:03.696952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:03.698259 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c6ea61b9-a6b3-4102-8733-55f6fc21ae32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.218905 Sep 14 19:58:03.702152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 182/368] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:03 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:03.760753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:03.761377 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:03.767502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.768220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.768664 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.770002 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.770470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.770902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.892082 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:03.893677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:03.902293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.903464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.904206 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.905300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:03.906123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:03.906733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:03.984000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:03.987179 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:03.990228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=100 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:03.994756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7d195b23-352b-459d-ab41-d1ce98b216b0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.237966 Sep 14 19:58:03.995668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 187/369] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:03 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:04.006950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-92af3e74-7f63-4a1a-a78d-581cc5c97b64 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1215 microversion: 2.1 time: 0.119244 Sep 14 19:58:04.007972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 183/370] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:03 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:04.336828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:04.337528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:04.343903 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:04.344389 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:04.344825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:04.345509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:04.346069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:04.346494 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:04.475926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:04.484827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e530cacb-a83a-40ce-8928-7b5b5f8a1f81 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.151893 Sep 14 19:58:04.487817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 188/371] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:04 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:04.724866 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:04.725514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:04.727757 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:04.732698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:04.733185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:04.733623 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:04.734337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:04.734796 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:04.735215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:04.871759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:04.882495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:04.884208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:04.885357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9079a1f0-3a48-4b0e-9db0-3205b5125583 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.164986 Sep 14 19:58:04.885928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 184/372] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:04 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:05.023274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:05.024197 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:05.032364 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:05.033702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:05.042960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.044479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.045233 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.045848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.046307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:05.047086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.047518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:05.048294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.048803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.049307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.049781 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:05.050323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:05.122934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:05.132346 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5c0cf541-a01d-4bdf-85ed-88b3e2684146 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1215 microversion: 2.1 time: 0.103629 Sep 14 19:58:05.133691 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 185/373] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:05 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:05.234124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:05.243495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0bf4586e-0957-4867-9e1c-1d3e0e601a90 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.225386 Sep 14 19:58:05.249754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 189/374] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:05 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:05.508814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:05.509425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:05.515696 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.516182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.516621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:05.517366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.517847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.518278 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:05.648808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:05.659386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-13bc0fbb-506e-4de3-8397-35372494c720 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.154388 Sep 14 19:58:05.660493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 186/375] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:05 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:05.912230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:05.917508 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:05.918980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.919476 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.919916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:05.920609 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:05.921197 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:05.921630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:06.052923 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:06.061054 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:06.062554 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:06.063708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-872c0003-5aae-4640-a57c-680dc8f80c20 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.155664 Sep 14 19:58:06.064261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 190/376] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:05 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:06.158417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:06.158980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:06.165911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:06.166388 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:06.166825 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:06.167499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:06.167946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:06.168364 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:06.242331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:06.250779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f07960be-4cc1-4a98-8da3-a97c3586e1fb tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1271 microversion: 2.1 time: 0.096177 Sep 14 19:58:06.252250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 187/377] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:06 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:06.268079 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:06.268693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:06.275485 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:06.276023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:06.276463 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:06.277170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:06.277626 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:06.278077 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:06.414807 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:06.424389 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9809c5e1-fb28-4148-b2f1-f8e3bc71c982 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.160134 Sep 14 19:58:06.424961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 191/378] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:06 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:06.683710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:06.684269 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:06.690242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:06.690727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:06.691727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:06.692399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:06.692851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:06.693307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:06.833843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:06.842383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0709fae0-f310-4c35-94c9-3d58aebdb17e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.162602 Sep 14 19:58:06.842952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 188/379] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:06 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:07.089935 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:07.090540 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:07.096404 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.096878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.097307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:07.098061 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.098515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.098934 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:07.254643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:07.263447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:07.264887 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:07.266121 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ce1126b2-5789-40e9-9298-8ffdd73a6fcd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1740 microversion: 2.20 time: 0.180139 Sep 14 19:58:07.266644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 192/380] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:07 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:07.273655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:07.274391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:07.276754 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=12 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:07.281863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.282612 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.283115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:07.283875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.284423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.285432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:07.347546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:07.355081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c0a450b1-e38d-469f-a960-0fe122c3572c tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1271 microversion: 2.1 time: 0.085753 Sep 14 19:58:07.355644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 189/381] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:07 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:07.448000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:07.448603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:07.454838 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.455347 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.455800 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:07.457127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.457570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.458097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:07.858211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:07.865217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:07.867153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:07.867268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5c7e2802-f46a-41c5-a38a-dd4e9e88fdcb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.422164 Sep 14 19:58:07.867268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 193/382] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:07 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:07.873007 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.873495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.873975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:07.875146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:07.875146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:07.875494 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.002156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:08.013027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bfa26be7-6e74-4e7d-9c3f-59343291a1e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.151052 Sep 14 19:58:08.020954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 190/383] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:07 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:08.293440 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:08.294141 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:08.302124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.302796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.303235 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.304119 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.304702 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.305188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.313281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:08.316407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:08.321240 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.321407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.321722 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.322463 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.322921 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.323351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.478431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:08.482699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:08.487872 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c3c5a147-bbde-477f-abd4-a60c88eeb06f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1593 microversion: 2.1 time: 0.178382 Sep 14 19:58:08.488951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 191/384] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:08 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1593 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:08.493788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:08.494416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:08.496730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:08.498831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:08.502517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8327e444-61d7-4144-8ac1-3c94f878661e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1722 microversion: 2.20 time: 0.211442 Sep 14 19:58:08.502517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 194/385] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:08 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:08.502840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.503556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.504163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.505072 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.505718 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.506444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.569477 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:08.577397 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-50bd48ee-d989-40fd-b52b-b2171169c63b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1271 microversion: 2.1 time: 0.087237 Sep 14 19:58:08.577986 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 192/386] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:08 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:08.889813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:08.890460 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:08.897097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.897545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.898017 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:08.898720 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:08.899161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:08.899595 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.036513 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:09.037178 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:09.043195 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.043682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.044112 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.044802 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.045253 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.045674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.179030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.187376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b5acf11c-5bf7-4e18-9ecd-7a3ad7b7fef3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.154691 Sep 14 19:58:09.189260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.193521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 193/387] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:09 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:09.208233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cf73fd9d-e357-4e76-90fe-655166c5074c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1502 microversion: 2.1 time: 0.322330 Sep 14 19:58:09.212320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 195/388] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:08 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:09.237643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8968950-7cd4-4c6c-a550-407c50b870b4"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:09.243377 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:09.258011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.258367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.258800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.259500 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.259951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.260366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.318643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] HTTP exception thrown: Cannot 'attach_volume' instance 6cb97b57-3da3-4808-904f-c0573b681648 while it is in vm_state rescued Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Request method failure captured: Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: POST /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648/os-volume_attachments HTTP/1.1 Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 74 Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHC0aHoqsUh3NYXw5S0NjtScfmAhqtQ_7KCs3E1xPXs3PjDdqG8hX__jCvqyY4bBMIxizbZDC30sI_OwS4Wfmd9lQT6fYu0i6zyak_x6jUWLxNCZG6MWb_mmYsjlb16N-PdYKBv5ddu76FV04I_OfIL3Ze4_gMIAwPkH5S3sWEpLdQ Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:58:09.319817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1dc64fa9e8e422fab6b3a66a29278ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}] Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 766dd5a650fc4855980250969854f08d Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {"volumeAttachment": {"volumeId": "d8968950-7cd4-4c6c-a550-407c50b870b4"}} Sep 14 19:58:09.321531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Cannot 'attach_volume' instance 6cb97b57-3da3-4808-904f-c0573b681648 while it is in vm_state rescued Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'server_id': '6cb97b57-3da3-4808-904f-c0573b681648', 'body': {'volumeAttachment': {'volumeId': 'd8968950-7cd4-4c6c-a550-407c50b870b4'}}} Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6cb97b57-3da3-4808-904f-c0573b681648 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:58:09.322451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6cb97b57-3da3-4808-904f-c0573b681648 while it is in vm_state rescued Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:58:09.323811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:58:09.325546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:58:09.325546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:58:09.325546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6cb97b57-3da3-4808-904f-c0573b681648 while it is in vm_state rescued Sep 14 19:58:09.325546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:58:09.330844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Returning 409 to user: Cannot 'attach_volume' instance 6cb97b57-3da3-4808-904f-c0573b681648 while it is in vm_state rescued {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:58:09.330844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-016c9bc5-c716-4556-8890-83c3d1fe69ec tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.094452 Sep 14 19:58:09.330844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 194/389] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:58:09 2022] POST /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648/os-volume_attachments => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 19:58:09.345776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:09.346426 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:09.355675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.356179 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.356619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.357352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.357823 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.358479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.418854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:09.527878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:09.528591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:09.535671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.536418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.536934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.537692 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.538237 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.538719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.656801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e5a3d5c4-a196-477e-89dd-1fff9321704b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648/action" status: 202 len: 0 microversion: 2.1 time: 0.319264 Sep 14 19:58:09.662021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 196/390] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:58:09 2022] POST /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:58:09.664628 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:09.665528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:09.679067 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.679569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.680006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.680857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.681526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.682225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.684005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.693052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.696421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.697525 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0ed49af8-7c01-43a4-9883-1672e1477f67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1722 microversion: 2.20 time: 0.172805 Sep 14 19:58:09.698535 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 195/391] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:09 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:09.703956 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:09.704812 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:09.713649 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.714618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.715278 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.717120 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:09.717768 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:09.718414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:09.802398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.810953 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f419686f-7d1d-4e9d-a721-6a93ecee559a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1289 microversion: 2.1 time: 0.151736 Sep 14 19:58:09.812164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 197/392] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:09 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1289 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:09.965699 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:09.983621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4a513f3b-6eb4-47f0-add7-17c8eb7143be tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1510 microversion: 2.1 time: 0.283030 Sep 14 19:58:09.985406 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 196/393] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:09 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:10.211088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:10.211727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:10.218405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:10.218894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:10.219332 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:10.220028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:10.220477 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:10.220898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:10.427337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:10.436685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-803bed25-d6c8-4bd5-a328-e2d1a58f0e15 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.229593 Sep 14 19:58:10.437916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 198/394] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:10 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:10.546075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-9c2ac732-a62a-4327-b5e6-37cd8a1d0911 req-e545891a-600b-4403-9ad0-76354efba106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a", "name": "network-vif-unplugged", "status": "completed", "tag": "127c779f-5b8f-4922-8168-11cb82065f9b"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:10.556475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9c2ac732-a62a-4327-b5e6-37cd8a1d0911 req-e545891a-600b-4403-9ad0-76354efba106 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:10.556956 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9c2ac732-a62a-4327-b5e6-37cd8a1d0911 req-e545891a-600b-4403-9ad0-76354efba106 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:10.557390 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9c2ac732-a62a-4327-b5e6-37cd8a1d0911 req-e545891a-600b-4403-9ad0-76354efba106 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:10.569155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-9c2ac732-a62a-4327-b5e6-37cd8a1d0911 req-e545891a-600b-4403-9ad0-76354efba106 service nova] Creating event network-vif-unplugged:127c779f-5b8f-4922-8168-11cb82065f9b for instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a on hv-cinder-83976 Sep 14 19:58:10.574353 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-9c2ac732-a62a-4327-b5e6-37cd8a1d0911 req-e545891a-600b-4403-9ad0-76354efba106 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031889 Sep 14 19:58:10.574938 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 197/395] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:58:10.724611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:10.725253 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:10.731986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:10.743011 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:10.743694 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:10.744438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:10.744899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:10.745323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:10.837245 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:10.842116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:10.846089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:10.846754 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:10.847399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:10.848304 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:10.848965 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:10.849789 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:10.991521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:10.998446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:10.999322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4fffcc60-6b0f-4b20-ac94-5c491f07fffd tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.167347 Sep 14 19:58:10.999917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 198/396] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:10 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:11.009814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:11.011138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:11.017861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:11.019547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:11.020081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:11.020520 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:11.021389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:11.021862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:11.022292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:11.022684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:11.024222 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:11.025619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f62e581b-1075-49b7-af6d-774a6ffcdaaf tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1722 microversion: 2.20 time: 0.305009 Sep 14 19:58:11.026585 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 199/397] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:10 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:11.172568 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:11.181031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b23f3540-6a5a-4918-a277-43c2552d8304 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1510 microversion: 2.1 time: 0.175998 Sep 14 19:58:11.181607 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 199/398] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:11 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:11.420444 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-b40bce2d-d711-49e6-979f-9bc2d1ff217a req-40c0da1a-d148-44c4-ae39-fd0e35ae8819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254fa332-f087-4923-a1f6-2975e927cc4a", "tag": "76215690-63a2-4250-9527-2472f8df9b4c"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:11.431599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b40bce2d-d711-49e6-979f-9bc2d1ff217a req-40c0da1a-d148-44c4-ae39-fd0e35ae8819 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:11.432419 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b40bce2d-d711-49e6-979f-9bc2d1ff217a req-40c0da1a-d148-44c4-ae39-fd0e35ae8819 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:11.432533 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b40bce2d-d711-49e6-979f-9bc2d1ff217a req-40c0da1a-d148-44c4-ae39-fd0e35ae8819 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:11.454054 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-b40bce2d-d711-49e6-979f-9bc2d1ff217a req-40c0da1a-d148-44c4-ae39-fd0e35ae8819 service nova] Creating event network-changed:76215690-63a2-4250-9527-2472f8df9b4c for instance 254fa332-f087-4923-a1f6-2975e927cc4a on hv-cinder-83976 Sep 14 19:58:11.461751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-b40bce2d-d711-49e6-979f-9bc2d1ff217a req-40c0da1a-d148-44c4-ae39-fd0e35ae8819 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044762 Sep 14 19:58:11.462841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 200/399] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:58:11.465870 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:11.473867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:11.474196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:11.474892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:11.475476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:11.476585 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:11.477230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:11.477830 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.002352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.021014 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-364186e7-8282-4713-ac7b-e4b827e30c00 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1723 microversion: 2.1 time: 0.558893 Sep 14 19:58:12.023200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 200/400] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:11 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1723 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:12.040901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:12.045335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:12.055856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:12.057721 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:12.064213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.065763 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.067278 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.070089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.070729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.072534 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.073752 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.075541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.078459 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.082580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.083689 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.085550 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.111403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=100 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:12.412174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.427379 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-29ccf3c5-bc8d-4220-afae-606ec9ad63c3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.406463 Sep 14 19:58:12.429082 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 201/401] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:12 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:12.443106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:12.446064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:12.464716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.465146 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.468137 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.468891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.469362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.474911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.579999 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.594527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.600210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.605408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f1a2282d-65f5-4b30-9cc2-3ea6c903ebb1 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1725 microversion: 2.20 time: 0.551127 Sep 14 19:58:12.606487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 201/402] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:12 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1725 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:12.641027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edd894a0-a2e1-444c-bd5e-801142e3cf13"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:12.645055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:12.652648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.653353 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.654089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.655338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:12.656001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:12.656644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:12.771631 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:12.782336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c8c5d615-daf1-4306-a27d-4afc5b46434f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1510 microversion: 2.1 time: 0.350689 Sep 14 19:58:12.783538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 202/403] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:12 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:13.046275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:13.046764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:13.053198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.054477 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.054923 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:13.055795 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.056295 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.056680 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:13.234897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:13.243515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-30a960db-df09-4613-a23c-4fab59513452 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1700 microversion: 2.1 time: 0.201721 Sep 14 19:58:13.244100 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 203/404] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:13 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1700 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:13.266078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f88948d4-3682-418c-a349-909aff4639f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:13.272638 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f88948d4-3682-418c-a349-909aff4639f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.273117 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f88948d4-3682-418c-a349-909aff4639f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.273553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f88948d4-3682-418c-a349-909aff4639f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:13.295598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f88948d4-3682-418c-a349-909aff4639f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Going to try to start instance {{(pid=132861) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 19:58:13.680781 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f88948d4-3682-418c-a349-909aff4639f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action" status: 202 len: 0 microversion: 2.1 time: 0.418126 Sep 14 19:58:13.681431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 204/405] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:58:13 2022] POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 19:58:13.686543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-8190ee07-ead8-4462-b29b-9468100b8476 req-0bf4c01d-16c5-4d74-9f12-8bcae19f80e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3389de1-2a95-4ab4-b206-8bf1c5c05bd7", "tag": "19fb278e-4135-4992-9eae-b30c639eea88"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:13.696698 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-8190ee07-ead8-4462-b29b-9468100b8476 req-0bf4c01d-16c5-4d74-9f12-8bcae19f80e8 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.697180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-8190ee07-ead8-4462-b29b-9468100b8476 req-0bf4c01d-16c5-4d74-9f12-8bcae19f80e8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.697640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-8190ee07-ead8-4462-b29b-9468100b8476 req-0bf4c01d-16c5-4d74-9f12-8bcae19f80e8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:13.709271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-8190ee07-ead8-4462-b29b-9468100b8476 req-0bf4c01d-16c5-4d74-9f12-8bcae19f80e8 service nova] Creating event network-changed:19fb278e-4135-4992-9eae-b30c639eea88 for instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 on hv-cinder-83976 Sep 14 19:58:13.713881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-8190ee07-ead8-4462-b29b-9468100b8476 req-0bf4c01d-16c5-4d74-9f12-8bcae19f80e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031199 Sep 14 19:58:13.714462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 205/406] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:58:13.723286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:13.723286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:13.728097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.728611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.729048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:13.729782 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.730316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.730979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:13.898585 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:13.906328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-df609a54-fee0-4416-bc60-b91068476b84 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.190525 Sep 14 19:58:13.906880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 206/407] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:13 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:13.911380 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:13.911987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:13.926065 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.926612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.927058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:13.927758 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:13.928215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:13.928645 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.081207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:14.091088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-64f16443-513e-4104-a69a-708ebc91e163 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1709 microversion: 2.1 time: 0.183162 Sep 14 19:58:14.103815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 207/408] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:13 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:14.113418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:14.114340 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:14.122268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.123028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.124016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.124743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.125205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.125629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.198337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5a554ee2-690f-4b9c-ad1a-ede0d21b4f0e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.565452 Sep 14 19:58:14.200137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 202/409] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Sep 14 19:58:12 2022] POST /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 188 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:58:14.352615 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:14.360683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-797b527e-da76-4b95-be05-3df7b9646d08 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1510 microversion: 2.1 time: 0.256898 Sep 14 19:58:14.361255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 208/410] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:14 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:14.396332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:14.396964 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:14.403797 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.404270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.404699 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.405387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.406067 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.406495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.453595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132862) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 19:58:14.848365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-122c6cdf-125e-4ca8-b268-a34c03f1d281 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/action" status: 202 len: 0 microversion: 2.20 time: 0.456483 Sep 14 19:58:14.849270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 203/411] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 19:58:14 2022] POST /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:58:14.857969 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:14.859141 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:14.865166 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.865726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.866260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.866966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.867424 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.867851 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.928540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:14.929143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:14.941410 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.942089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.942605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:14.943407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:14.943950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:14.944452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:15.027057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:15.042833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:15.049735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:15.052674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-91ba4cfc-e244-40a1-a21a-2b762740332c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1751 microversion: 2.20 time: 0.197806 Sep 14 19:58:15.055408 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 209/412] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:14 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:15.120343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:15.121634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:15.131704 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:15.132450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:15.133038 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:15.134027 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:15.134470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:15.135051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:15.192996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:15.202245 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-760413cb-3dce-452b-8503-6ea7e70f63b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.277133 Sep 14 19:58:15.204934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 204/413] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:14 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:15.289602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:15.298854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2e06b0ae-05bd-4059-bb4d-6b6610b092ff tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1709 microversion: 2.1 time: 0.186102 Sep 14 19:58:15.299698 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 210/414] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:15 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1709 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:15.385328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:15.386022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:15.393614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:15.394762 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:15.395183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:15.395884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:15.396337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:15.396744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:15.752800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:15.762594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-152a6a2b-ef7d-49d9-8405-450f14d89ea2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1516 microversion: 2.1 time: 0.381136 Sep 14 19:58:15.763727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 205/415] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:15 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1516 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:15.834099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-945011526"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:15.834866 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:15.845493 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:15.846640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:15.847088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:15.847826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:15.848282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:15.848821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.029761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.network.security_group_api [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Adding security group aa56f973-ee43-412a-b7f2-d2d5b44b3fd3 to port 76215690-63a2-4250-9527-2472f8df9b4c Sep 14 19:58:16.081711 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:16.082445 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:16.092006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.092730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.093899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.094617 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.095262 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.095852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.531384 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:16.543157 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:16.544800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:16.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0615c4f9-2678-4d71-9b2f-0a4935b0fd32 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1751 microversion: 2.20 time: 0.469366 Sep 14 19:58:16.546760 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 206/416] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:16 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1751 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:16.557219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:16.558233 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:16.573418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.573418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.573418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.573732 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.574126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.574988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.658588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e9239c32-7118-4cf6-95b6-88b649301025 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/action" status: 202 len: 0 microversion: 2.1 time: 0.828043 Sep 14 19:58:16.661781 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 211/417] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:58:15 2022] POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:58:16.666587 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:16.667875 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:16.683499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.685239 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.685239 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.685239 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.685571 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.686028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.779254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:16.789823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-cbcf59c9-31a2-4ca6-98bf-c2e5991321d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.237275 Sep 14 19:58:16.790783 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 207/418] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:16 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:16.804723 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:16.806462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:16.817123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.817744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.818319 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.819217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.819851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.820529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.910885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:16.919692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c2d960f2-2e64-4dd8-a8a9-aae4dc9c7cf4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1709 microversion: 2.1 time: 0.256802 Sep 14 19:58:16.920261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 212/419] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:16 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:16.924872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-03e349a6-3f2c-4a96-bea9-67efd39ffbd0 req-10fbdf68-1d22-4a04-a80e-c2354ba7de0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254fa332-f087-4923-a1f6-2975e927cc4a", "tag": "76215690-63a2-4250-9527-2472f8df9b4c"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:16.934584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:16.936718 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-03e349a6-3f2c-4a96-bea9-67efd39ffbd0 req-10fbdf68-1d22-4a04-a80e-c2354ba7de0a service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:16.937369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-03e349a6-3f2c-4a96-bea9-67efd39ffbd0 req-10fbdf68-1d22-4a04-a80e-c2354ba7de0a service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:16.938371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-03e349a6-3f2c-4a96-bea9-67efd39ffbd0 req-10fbdf68-1d22-4a04-a80e-c2354ba7de0a service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:16.952606 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-03e349a6-3f2c-4a96-bea9-67efd39ffbd0 req-10fbdf68-1d22-4a04-a80e-c2354ba7de0a service nova] Creating event network-changed:76215690-63a2-4250-9527-2472f8df9b4c for instance 254fa332-f087-4923-a1f6-2975e927cc4a on hv-cinder-83976 Sep 14 19:58:16.960084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-03e349a6-3f2c-4a96-bea9-67efd39ffbd0 req-10fbdf68-1d22-4a04-a80e-c2354ba7de0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Sep 14 19:58:16.961118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 213/420] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:58:16.987206 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:16.995619 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2f11eae0-3772-44e2-8695-817df8132597 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1757 microversion: 2.1 time: 0.203401 Sep 14 19:58:16.996228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 208/421] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:16 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:17.576323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:17.577168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:17.584144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:17.584543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:17.584971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:17.585649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:17.586140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:17.586559 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:17.605752 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:17.651249 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1365afc9-8428-48d2-b777-e461c2b623fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'create', calling method: .version_select at 0x7f19e5606b80>, body: {"keypair": {"name": "tempest-keypair-1226787762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoX1eByz/LuSaThJ9z5RC5QXR7MtXg/ll14b0Q0loud6CGgD5YfYgDFmPx3oq1mtzxQ8TeUtA1lI/2diI7VRXdkIPHD8hDeiT2z7kkL+r65Ili0rEut8hEU5IwNWMSMWA=="}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:17.668452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-1365afc9-8428-48d2-b777-e461c2b623fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:58:17.680010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-1365afc9-8428-48d2-b777-e461c2b623fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for user 766dd5a650fc4855980250969854f08d and project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:58:17.724465 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:17.733070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:17.734531 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:17.735661 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d07dcf5e-e55c-4d06-bacc-0a3410a2ba55 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1751 microversion: 2.20 time: 0.164081 Sep 14 19:58:17.736220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 214/422] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:17 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:17.770106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1365afc9-8428-48d2-b777-e461c2b623fe tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122754 Sep 14 19:58:17.770713 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 209/423] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 19:58:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:17.816620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:17.817223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:17.823262 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:17.823738 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:17.824165 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:17.825132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:17.825581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:17.826030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:17.943786 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:17.944389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:17.950687 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:17.951166 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:17.951622 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:17.952303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:17.952748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:17.953163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:17.991488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:18.001381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6aedc384-fcdc-4855-9057-e08284dd2c57 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.188979 Sep 14 19:58:18.002303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 215/424] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:17 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:18.087839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:18.096450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5095595a-e15d-4fe0-9a35-fa661df695ce tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1709 microversion: 2.1 time: 0.156574 Sep 14 19:58:18.097254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 210/425] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:17 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:18.762178 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:18.762914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:18.771560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:18.771560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:18.771980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:18.775640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:18.775640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:18.775640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:18.917252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:18.925643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:18.927128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:18.928260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1048e4fe-accd-456a-afaa-08b4aa36b951 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1753 microversion: 2.20 time: 0.170561 Sep 14 19:58:18.928945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 216/426] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:18 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:19.024813 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:19.025427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:19.032131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:19.032821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:19.033227 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:19.034105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:19.034484 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:19.035465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:19.119840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:19.120479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:19.127088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:19.127600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:19.128008 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:19.129255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:19.129709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:19.130152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:19.312031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:19.325521 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-86bd1f6b-489c-4f25-b951-a1d142fbedbc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1713 microversion: 2.1 time: 0.209422 Sep 14 19:58:19.337824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 217/427] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:19 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1713 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:19.340610 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:19.352328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5369ad72-3afe-4231-88af-ac0cb836bd54 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.331429 Sep 14 19:58:19.368885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 211/428] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:19 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:19.959085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:19.959764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:19.966503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:19.966989 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:19.967429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:19.968161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:19.968621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:19.969047 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:20.105563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:20.114542 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:20.116025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:20.117172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f89da130-3c87-40da-8eaa-9a9213e9e496 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1753 microversion: 2.20 time: 0.161977 Sep 14 19:58:20.117731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 218/429] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:19 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:20.375542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:20.376152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:20.383343 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:20.383828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:20.384262 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:20.384946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:20.385434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:20.385883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:20.569100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:20.577250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f5a129b6-5ad1-40f6-8de5-b549f679ce30 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.205513 Sep 14 19:58:20.587293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 212/430] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:20 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:20.780960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-36a602a6-152c-489f-b6df-136215952d94 req-cf6dc79c-5ab6-40c8-ac0f-19587670b88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3389de1-2a95-4ab4-b206-8bf1c5c05bd7", "name": "network-vif-plugged", "status": "completed", "tag": "19fb278e-4135-4992-9eae-b30c639eea88"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:20.786220 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2055161128", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebf7e7ae-b3ea-433e-935a-edccba421b3a"}], "security_groups": [{"name": "tempest-securitygroup--152766468"}], "key_name": "tempest-keypair-1226787762", "user_data": "}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:20.794213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-36a602a6-152c-489f-b6df-136215952d94 req-cf6dc79c-5ab6-40c8-ac0f-19587670b88d service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:20.794708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-36a602a6-152c-489f-b6df-136215952d94 req-cf6dc79c-5ab6-40c8-ac0f-19587670b88d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:20.795147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-36a602a6-152c-489f-b6df-136215952d94 req-cf6dc79c-5ab6-40c8-ac0f-19587670b88d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:20.806798 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-36a602a6-152c-489f-b6df-136215952d94 req-cf6dc79c-5ab6-40c8-ac0f-19587670b88d service nova] Creating event network-vif-plugged:19fb278e-4135-4992-9eae-b30c639eea88 for instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 on hv-cinder-83976 Sep 14 19:58:20.811837 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-36a602a6-152c-489f-b6df-136215952d94 req-cf6dc79c-5ab6-40c8-ac0f-19587670b88d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036253 Sep 14 19:58:20.815415 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 219/431] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:20.913446 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] validate_networks() for [('ebf7e7ae-b3ea-433e-935a-edccba421b3a', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:58:21.143794 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:21.145008 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:21.152855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:21.153647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:21.154277 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:21.155009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:21.155544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:21.155977 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:21.309344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:21.322704 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:21.327971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:21.334246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0eeeb91c-338e-4e47-b63e-be8ae6100904 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.189959 Sep 14 19:58:21.343848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 220/432] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:21 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:21.399535 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:58:21.399991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:58:21.400445 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:58:21.400853 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:58:21.401274 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:58:21.410491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:21.411002 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:21.411433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:21.412157 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:21.412604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:21.413031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:21.430088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:58:21.434176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Getting quotas for user 766dd5a650fc4855980250969854f08d and project e1dc64fa9e8e422fab6b3a66a29278ff. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:58:21.445079 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:58:21.447437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:58:21.608965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:21.609492 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:21.616363 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:21.616844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:21.617506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:21.618247 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:21.618857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:21.619428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:21.706441 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a62439a4-c022-4469-809f-cd030205caed tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.925077 Sep 14 19:58:21.707522 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 213/433] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:58:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:58:21.719180 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ef0242ad-689a-45a0-8a79-96bef778f272 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:21.720199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ef0242ad-689a-45a0-8a79-96bef778f272 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:21.754782 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:21.764118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-24fd03a4-6e03-405c-b97d-b141ade03446 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.159244 Sep 14 19:58:21.764912 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 221/434] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:21 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:21.783787 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ef0242ad-689a-45a0-8a79-96bef778f272 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:21.791442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ef0242ad-689a-45a0-8a79-96bef778f272 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1246 microversion: 2.1 time: 0.076368 Sep 14 19:58:21.792001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 214/435] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:21 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:22.360501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:22.361131 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:22.368050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:22.368534 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:22.368969 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:22.369647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:22.370124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:22.370545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:22.503580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:22.512371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:22.513840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:22.515027 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6a7a17ec-fe44-4707-aad4-4b514a2eb0a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.158387 Sep 14 19:58:22.515877 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 222/436] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:22 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:22.787652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:22.788273 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:22.794952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:22.795441 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:22.795881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:22.796615 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:22.797017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:22.797483 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:22.814054 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:22.814700 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:22.820605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:22.821093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:22.821530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:22.822258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:22.822716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:22.823139 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:22.890895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:22.900456 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e51a232a-c99c-49fd-b59a-5335889c2777 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1250 microversion: 2.1 time: 0.090265 Sep 14 19:58:22.901128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 223/437] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:22 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1250 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:22.930035 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:22.938407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5f8349d2-0db3-46f9-8c5e-a69b7fb5aed0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1319 microversion: 2.1 time: 0.155185 Sep 14 19:58:22.938979 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 215/438] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:22 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:23.540819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:23.541574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:23.548056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:23.548632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:23.549131 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:23.549916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:23.550963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:23.551473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:23.693125 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:23.702589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:23.704128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:23.705292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4e282dbc-8a74-466b-a444-dacefdaef8c3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.168384 Sep 14 19:58:23.706148 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 224/439] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:23 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:23.927098 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:23.927723 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:23.934161 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:23.934645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:23.935070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:23.935919 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:23.941720 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:23.941720 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:23.961945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:23.962841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:23.969390 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:23.969999 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:23.970535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:23.971294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:23.971844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:23.972832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:24.005391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:24.023756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-be76e2cd-1b78-42cb-87e9-7670c6dc99f6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1242 microversion: 2.1 time: 0.101016 Sep 14 19:58:24.024980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 216/440] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:23 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:24.116168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:24.123949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cae17277-e9be-4866-852e-4cf82cf59540 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1507 microversion: 2.1 time: 0.165915 Sep 14 19:58:24.124703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 225/441] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:23 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:24.734761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:24.735501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:24.747653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:24.748328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:24.748872 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:24.749727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:24.750485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:24.751178 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:24.754857 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:24.924411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:24.935538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:24.937114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:24.938427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1c741242-5d6d-4138-9e1c-623154d3084a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.207605 Sep 14 19:58:24.938986 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 217/442] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:24 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:25.051777 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:25.052417 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:25.058487 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:25.058974 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:25.059410 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:25.060138 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:25.060621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:25.061044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:25.140214 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:25.149024 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-11857eb2-2531-410a-8ee6-ae04a80e3b54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.102822 Sep 14 19:58:25.149599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 226/443] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:25 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:25.965856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:25.966493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:25.973432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:25.973875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:25.974312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:25.975266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:25.975838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:25.976310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:26.116673 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:26.126841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:26.129613 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:26.131142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fbbfd0fe-2ff5-43f3-b96b-fbfe84e1e644 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.169231 Sep 14 19:58:26.131907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 218/444] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:25 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:26.173138 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:26.173939 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:26.182236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:26.182908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:26.184195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:26.185312 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:26.185925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:26.186870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:26.254721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:26.262445 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-06314f57-1b21-4107-b428-a8eccc55ce0d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.093860 Sep 14 19:58:26.263012 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 227/445] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:26 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:27.162568 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:27.163341 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:27.170068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:27.170560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:27.171041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:27.171745 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:27.172266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:27.172698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:27.288699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:27.289342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:27.297134 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:27.297636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:27.302588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:27.304636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:27.306014 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:27.307931 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:27.324003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:27.336937 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:27.338450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:27.339647 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6fb92b3b-8996-47b0-b637-f1828034245d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.182027 Sep 14 19:58:27.353835 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 219/446] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:27 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:27.400538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:27.406158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1a3052d4-1418-4515-a5b9-2355c6aa0988 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.122772 Sep 14 19:58:27.406819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 228/447] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:27 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:28.369537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:28.370183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:28.385163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:28.385789 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:28.386243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:28.387416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:28.387876 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:28.388364 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:28.430571 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:28.431177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:28.437207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:28.438104 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:28.438233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:28.438824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:28.439275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:28.439709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:28.583855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:28.583855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3401901c-b857-4e99-abc3-1e8acb1d8598 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.150653 Sep 14 19:58:28.583855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 229/448] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:28 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:28.606381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:28.615769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:28.617356 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:28.618749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-61d36f2a-0129-43f6-ab0f-f317ca224600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.253221 Sep 14 19:58:28.619319 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 220/449] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:28 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:29.605043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:29.605672 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:29.612470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:29.612963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:29.613428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:29.614174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:29.614641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:29.615045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:29.646028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:29.647416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:29.676577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:29.677078 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:29.677640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:29.678611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:29.679063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:29.679486 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:29.685213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:29.694546 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-24188020-c7ec-4220-ab51-d23e706ccd2b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.093271 Sep 14 19:58:29.695273 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 230/450] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:29 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:29.839347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:29.848153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:29.849606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:29.850824 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-53d68b37-d3ca-4954-b183-c324a84a6c31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.210178 Sep 14 19:58:29.851380 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 221/451] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:29 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:30.718874 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:30.719462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:30.726129 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:30.726621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:30.727467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:30.728106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:30.728622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:30.729052 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:30.797506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:30.801068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:30.805542 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-04be589f-5564-4a60-936b-0ec4923cdd54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.091078 Sep 14 19:58:30.806212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 231/452] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:30 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:30.877964 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:30.878600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:30.885238 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:30.885726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:30.886205 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:30.886917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:30.887403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:30.887828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:31.030661 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:31.041705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:31.043643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:31.044937 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f3b8ce54-84ca-4c6e-8228-3fed75a4b922 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.171030 Sep 14 19:58:31.045491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 222/453] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:30 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:31.830578 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:31.831202 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:31.838139 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:31.838665 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:31.839110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:31.839854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:31.840331 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:31.840811 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:31.907015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:31.915923 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1e7240ae-2dbe-4b84-84f0-d8fcfe1ff53e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.089657 Sep 14 19:58:31.916922 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 232/454] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:31 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:32.072527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:32.073153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:32.075269 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:32.075961 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=12 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:32.081146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:32.081558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:32.082030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:32.082711 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:32.083157 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:32.083573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:32.252628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:32.262437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:32.263888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:32.265139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-88583167-7035-4340-94fd-6d769a433c54 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.196507 Sep 14 19:58:32.266119 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 223/455] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:32 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:32.943302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:32.944518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:32.950719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:32.951244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:32.951710 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:32.952417 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:32.952890 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:32.953507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:33.021434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:33.029473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8a960898-254b-42f9-84d0-acba379d82d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.092183 Sep 14 19:58:33.030163 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 233/456] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:32 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:33.292267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:33.292940 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:33.299370 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:33.301162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:33.301162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:33.301549 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:33.302033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:33.302466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:33.444972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:33.460453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:33.462336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:33.463573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-07ba9609-a915-449f-b4f2-3f0010a8e76e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.175376 Sep 14 19:58:33.464217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 224/457] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:33 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:34.060243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:34.071949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:34.071949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:34.071949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:34.071949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:34.072345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:34.072345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:34.072345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:34.147605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:34.155960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-65b1e4c7-434d-406b-8d09-856a0e21d814 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.106015 Sep 14 19:58:34.159449 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 234/458] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:34 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:34.490934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:34.491566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:34.498252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:34.498766 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:34.499250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:34.499949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:34.500398 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:34.500819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:34.637695 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:34.656424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:34.658330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:34.660403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-47be681a-c078-4ac2-a238-c3e96aa51600 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.173776 Sep 14 19:58:34.661588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 225/459] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:34 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:35.181345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:35.182629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:35.188979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:35.189489 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:35.190046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:35.190977 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:35.191642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:35.192147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:35.260056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:35.268084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-45a04165-1933-4344-98a7-4524541a83a7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1298 microversion: 2.1 time: 0.090716 Sep 14 19:58:35.268745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 235/460] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:35 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:35.686638 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:35.687249 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:35.694135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:35.694619 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:35.695057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:35.695761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:35.696213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:35.696641 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:35.837434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:35.846425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:35.847804 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:35.848963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ba4ffa82-c783-4a6d-957b-3c7d5de948b6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.166189 Sep 14 19:58:35.849654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 226/461] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:35 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:36.292675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:36.293314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:36.299320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:36.299805 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:36.300245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:36.301431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:36.301911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:36.302338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:36.361060 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:36.368988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5a85b384-00af-4944-b86f-f05cbc787991 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1306 microversion: 2.1 time: 0.080205 Sep 14 19:58:36.369541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 236/462] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:36 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1306 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:36.884040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:36.884759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:36.895000 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:36.899106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:36.900682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:36.900682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:36.900888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:36.901274 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:37.337253 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:37.345312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:37.346800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:37.347958 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a748da06-4142-46c5-b7cc-13fba2c6fbfc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.468055 Sep 14 19:58:37.348516 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 227/463] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:36 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:37.392604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:37.393234 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:37.399483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:37.400187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:37.400656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:37.401343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:37.401820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:37.402266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:37.464106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:37.471918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6201ee24-8bc2-47de-a687-1bf4e3517515 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1304 microversion: 2.1 time: 0.083189 Sep 14 19:58:37.473010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 237/464] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:37 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:38.374057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:38.374802 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:38.381324 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:38.381836 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:38.382528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:38.383141 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:38.383769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:38.384526 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:38.499656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:38.500241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:38.506397 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:38.506883 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:38.507816 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:38.508547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:38.509003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:38.509423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:38.645668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:38.649988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:38.655423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:38.656968 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:38.658198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6afb8871-e1a4-417c-b85c-6f53a639c3e9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.162625 Sep 14 19:58:38.658563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f00facbc-c97c-48ae-a36c-181773fc6d9f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.288443 Sep 14 19:58:38.670280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 238/466] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:38 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:38.670438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 228/466] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:38 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:38.942472 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-1f9dc7a4-73fa-46c0-b2dd-88aa55207a24 req-77cb781a-8db2-44d6-b9ef-59ea86c7c09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75fbf44-86a1-4b99-97a3-d7e04415ac72", "tag": "ae006861-47e1-449b-b3aa-d229e77ec13d"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:38.953287 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1f9dc7a4-73fa-46c0-b2dd-88aa55207a24 req-77cb781a-8db2-44d6-b9ef-59ea86c7c09d service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:38.954531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1f9dc7a4-73fa-46c0-b2dd-88aa55207a24 req-77cb781a-8db2-44d6-b9ef-59ea86c7c09d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:38.954531 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1f9dc7a4-73fa-46c0-b2dd-88aa55207a24 req-77cb781a-8db2-44d6-b9ef-59ea86c7c09d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:38.966635 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-1f9dc7a4-73fa-46c0-b2dd-88aa55207a24 req-77cb781a-8db2-44d6-b9ef-59ea86c7c09d service nova] Creating event network-changed:ae006861-47e1-449b-b3aa-d229e77ec13d for instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 on hv-cinder-83976 Sep 14 19:58:38.973567 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-1f9dc7a4-73fa-46c0-b2dd-88aa55207a24 req-77cb781a-8db2-44d6-b9ef-59ea86c7c09d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036402 Sep 14 19:58:38.974203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 229/467] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:58:39.682776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:39.683405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:39.685737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:39.686462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:39.689731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:39.690253 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:39.690674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:39.691859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:39.692331 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:39.692728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:39.693107 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:39.693591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:39.694053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:39.694738 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:39.695190 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:39.695634 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:39.838208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:39.849156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:39.851077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:39.852562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9fb4ed91-98a2-44f7-af69-1f916c4ed771 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.170965 Sep 14 19:58:39.853374 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 230/468] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:39 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:40.086556 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:40.094462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-705188eb-eb0b-41d0-ba7c-6756dabf0a37 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.415541 Sep 14 19:58:40.095019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 239/469] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:39 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:40.880372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:40.880983 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:40.887508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:40.887988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:40.888455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:40.889135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:40.889581 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:40.890105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:41.022381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:41.031044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:41.032491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:41.033671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c3fc08a7-6cfc-4ffc-9b03-f1e8a42bf6c4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.157818 Sep 14 19:58:41.034298 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 231/470] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:40 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:41.128364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:41.128364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:41.128364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:41.128364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:41.129030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:41.129030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:41.129030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:41.129030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:41.261425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:41.269231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-aa89a54a-b5c2-4baa-89e9-e76a75f863c3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.155994 Sep 14 19:58:41.270510 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 240/471] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:41 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:41.376660 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:41.379035 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:41.382085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:41.385385 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:41.385885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:41.386316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:41.386989 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:41.387438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:41.387861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:41.727542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3471cc8c-029e-41d2-adbd-4ba084ff5c39 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/action" status: 202 len: 0 microversion: 2.1 time: 0.354691 Sep 14 19:58:41.731351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 232/472] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:58:41 2022] POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:58:41.736142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:41.736751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:41.743515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:41.744066 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:41.744423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:41.745116 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:41.745569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:41.746026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:41.900810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:41.908983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e753f1fa-92a2-4c8a-9922-8ff7cb927bcc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1749 microversion: 2.1 time: 0.176589 Sep 14 19:58:41.909546 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 241/473] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:41 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:42.060243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:42.061046 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:42.067689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:42.068171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:42.068604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:42.069336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:42.069792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:42.070235 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:42.088114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:42.219547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:42.223892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:42.225343 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:42.226725 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-83025114-7515-4387-8783-0eda4b577b63 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.171217 Sep 14 19:58:42.227482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 233/474] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:42 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:42.292770 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:42.293395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:42.299506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:42.299986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:42.300416 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:42.301626 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:42.302141 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:42.302530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:42.435213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:42.444552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a9f28c16-28bd-4390-ab94-dba51133644b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.155638 Sep 14 19:58:42.445183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 242/475] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:42 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:42.932699 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:42.933302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:42.939864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:42.940347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:42.940963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:42.944982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:42.944982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:42.944982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:43.094717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:43.104144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5cff47f9-64b0-436a-8605-5123e9f346d0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1749 microversion: 2.1 time: 0.175904 Sep 14 19:58:43.105263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 234/476] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:42 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:43.268346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:43.268971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:43.275619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:43.276124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:43.276558 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:43.277688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:43.278160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:43.278582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:43.434935 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:43.448434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:43.450387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:43.452275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b13c9d4e-9fcb-4245-934b-43ca66c948e2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.203071 Sep 14 19:58:43.467891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 243/477] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:43 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:43.468788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:43.469590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:43.476485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:43.476979 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:43.477403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:43.478116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:43.478594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:43.479093 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:43.693299 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:43.703231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d99f800f-3b09-47fc-a74e-3a7fbb9e6c36 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.238549 Sep 14 19:58:43.703827 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 235/478] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:43 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:44.128601 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:44.130666 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:44.136461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:44.136942 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:44.137388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:44.138121 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:44.138570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:44.140120 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:44.297057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.305312 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1347af3a-6fa6-439b-875d-baf25a76a1b9 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.180636 Sep 14 19:58:44.305891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 244/479] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:44 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:44.480518 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:44.481125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:44.487559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:44.488038 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:44.488493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:44.489144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:44.489589 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:44.490032 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:44.623001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.632025 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.633515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.634689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-557b8b2e-9bf3-4f08-b7ff-1fa687d951f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.158196 Sep 14 19:58:44.635235 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 236/480] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:44 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:44.726223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:44.726935 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:44.732813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:44.733296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:44.733761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:44.734468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:44.735417 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:44.735417 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:44.861849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:44.870100 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3da51880-069c-4b59-8321-9ebbdac1ea70 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.147695 Sep 14 19:58:44.870658 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 245/481] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:44 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:45.328459 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:45.329067 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:45.336006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:45.336489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:45.336924 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:45.337610 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:45.338192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:45.341364 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:45.568713 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.577665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b863d4a2-4523-45db-b1fb-b4c2db818c0c tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.253407 Sep 14 19:58:45.578674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 237/482] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:45 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:45.661119 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:45.661734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:45.668245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:45.669042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:45.669482 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:45.670408 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:45.671009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:45.671588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:45.805443 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.814300 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.815776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:45.817574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a3dd824a-f37d-44f1-9dbb-b2ac2415779e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.160786 Sep 14 19:58:45.818229 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 246/483] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:45 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:45.893180 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:45.894231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:45.900429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:45.900932 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:45.901368 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:45.902115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:45.902743 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:45.903326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:46.036036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:46.043864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6bc30682-e378-43cb-8548-f50d2d3330d7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.154975 Sep 14 19:58:46.044496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 238/484] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:45 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:46.152697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-26016eaa-d229-4626-bbdd-7845f3a3b6fd req-97474ac2-7181-4af5-97db-c22570d8679d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a", "name": "network-vif-plugged", "status": "completed", "tag": "127c779f-5b8f-4922-8168-11cb82065f9b"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:46.165995 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-26016eaa-d229-4626-bbdd-7845f3a3b6fd req-97474ac2-7181-4af5-97db-c22570d8679d service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:46.165995 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-26016eaa-d229-4626-bbdd-7845f3a3b6fd req-97474ac2-7181-4af5-97db-c22570d8679d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:46.165995 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-26016eaa-d229-4626-bbdd-7845f3a3b6fd req-97474ac2-7181-4af5-97db-c22570d8679d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:46.176558 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-26016eaa-d229-4626-bbdd-7845f3a3b6fd req-97474ac2-7181-4af5-97db-c22570d8679d service nova] Creating event network-vif-plugged:127c779f-5b8f-4922-8168-11cb82065f9b for instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a on hv-cinder-83976 Sep 14 19:58:46.181472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-26016eaa-d229-4626-bbdd-7845f3a3b6fd req-97474ac2-7181-4af5-97db-c22570d8679d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Sep 14 19:58:46.182118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 247/485] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:46.602050 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:46.602665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:46.608889 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:46.609369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:46.609832 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:46.610501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:46.610947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:46.611362 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:46.755482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:46.763728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1b1f0bc9-5aef-4a8a-b727-68a846c0c3d7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.165584 Sep 14 19:58:46.764295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 239/486] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:46 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:46.844694 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:46.845900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:46.852236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:46.852719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:46.853151 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:46.853884 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:46.854335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:46.854762 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:46.992221 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:47.001241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:47.002745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:47.004430 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8e3c2583-e92f-4d26-8d9b-f699eb5194d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.163737 Sep 14 19:58:47.004993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 248/487] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:46 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:47.068475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:47.069092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:47.075163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:47.075898 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:47.076345 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:47.077050 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:47.077499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:47.077957 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:47.219463 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:47.227240 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-26ca6808-a6e0-4aad-aecd-bf521cdd00ab tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.163202 Sep 14 19:58:47.227894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 240/488] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:47 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:47.788337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:47.788942 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:47.790932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=72 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:47.795617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:47.796100 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:47.796529 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:47.797211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:47.797655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:47.798103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:47.802062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:47.946044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:47.954466 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d104b65e-f535-4951-b2e0-86fe5e3111e7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.170025 Sep 14 19:58:47.955021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 249/489] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:47 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:48.030599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:48.031264 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:48.037820 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:48.038313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:48.038750 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:48.039485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:48.039942 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:48.040373 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:48.169446 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.178345 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.179789 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.181001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-026303e6-6875-4335-abd9-503ce1fbc9a8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.154470 Sep 14 19:58:48.181544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 241/490] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:48 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:48.199427 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-c88f06bf-56b6-4919-8101-beb0bb11ffb2 req-5a56a68b-48db-4040-a324-0ffda53df87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75fbf44-86a1-4b99-97a3-d7e04415ac72", "name": "network-vif-plugged", "status": "completed", "tag": "ae006861-47e1-449b-b3aa-d229e77ec13d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:48.210643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c88f06bf-56b6-4919-8101-beb0bb11ffb2 req-5a56a68b-48db-4040-a324-0ffda53df87e service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:48.211118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c88f06bf-56b6-4919-8101-beb0bb11ffb2 req-5a56a68b-48db-4040-a324-0ffda53df87e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:48.211545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c88f06bf-56b6-4919-8101-beb0bb11ffb2 req-5a56a68b-48db-4040-a324-0ffda53df87e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:48.222103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-c88f06bf-56b6-4919-8101-beb0bb11ffb2 req-5a56a68b-48db-4040-a324-0ffda53df87e service nova] Creating event network-vif-plugged:ae006861-47e1-449b-b3aa-d229e77ec13d for instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 on hv-cinder-83976 Sep 14 19:58:48.227407 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-c88f06bf-56b6-4919-8101-beb0bb11ffb2 req-5a56a68b-48db-4040-a324-0ffda53df87e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Sep 14 19:58:48.227980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 250/491] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:48.249283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:48.249935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:48.255739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:48.256216 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:48.256647 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:48.257332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:48.257780 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:48.258266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:48.387673 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:48.396741 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-23dedcc7-b8b7-4312-b9f7-c73fe8f1fb23 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.151508 Sep 14 19:58:48.397496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 242/492] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:48 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:48.980238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:48.981012 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:48.987265 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:48.987890 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:48.988877 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:48.989649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:48.990170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:48.990664 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:49.139197 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.148140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-dc43325e-cace-4bf3-aa04-41f0831687bc tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.172184 Sep 14 19:58:49.149276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 251/493] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:48 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:49.207396 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:49.207898 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:49.214838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:49.215488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:49.216064 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:49.216901 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:49.217521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:49.218130 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:49.366214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.378604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.380777 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.382729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-27ac9644-56b2-4833-9a8a-49e0627a7cab tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.179419 Sep 14 19:58:49.383856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 243/494] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:49 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:49.419988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:49.420831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:49.428089 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:49.429054 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:49.429655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:49.430490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:49.431204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:49.431567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:49.575562 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:49.584029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-94cceb52-55ca-4761-a806-9bfaf15a85d3 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.168231 Sep 14 19:58:49.590030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 252/495] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:49 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:50.172026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:50.172719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:50.178986 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.179470 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.184616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.184616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.184616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.184616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.332101 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.340913 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-72ad2e5e-b8af-4b17-ac27-bad9677bc352 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.172627 Sep 14 19:58:50.341482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 244/496] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:50 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:50.412568 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:50.412568 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:50.416676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.417165 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.417601 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.418434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.418879 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.419303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.556583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.569346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.569346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.569346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-60748267-2356-4c57-af12-c21fef8cafea tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1809 microversion: 2.20 time: 0.162511 Sep 14 19:58:50.569823 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 253/497] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:50 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 19:58:50.607849 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:50.608468 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:50.617768 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.618402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.618835 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.619567 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.620027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.623453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.688699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b13adf6-ead6-45f1-922b-3ef443cdaaa1", "device": "/dev/sdb"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:50.692086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:50.699152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.699911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.700524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.701855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:50.702550 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:50.703237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:50.791521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:50.801874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4f915dd4-53f5-43a0-a801-d47d764f65c7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1371 microversion: 2.1 time: 0.197566 Sep 14 19:58:50.803098 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 245/498] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:50 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:51.364863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:51.365512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:51.372197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:51.372899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:51.373340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:51.374082 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:51.374539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:51.374972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:51.523000 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.531327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-872bddf8-6a76-45e1-9709-3aee7b3df0c1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.170378 Sep 14 19:58:51.531905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 246/499] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:51 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:51.594337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:51.594952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:51.600837 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:51.601328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:51.601771 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:51.602481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:51.602939 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:51.603368 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:51.736463 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.747440 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.749471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.750885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f11a00d0-d300-4cc9-a0d4-19e6ae7ffba4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1796 microversion: 2.20 time: 0.160372 Sep 14 19:58:51.754329 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 247/500] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 19:58:51 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1796 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 19:58:51.826529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:51.827141 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:51.833070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:51.833552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:51.834033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:51.834726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:51.835258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:51.835688 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:51.970487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:51.978228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-79080bbc-1822-40e9-b3a6-22f858767f6a tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1564 microversion: 2.1 time: 0.155910 Sep 14 19:58:51.978788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 248/501] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:51 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:58:52.000790 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:52.001272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:52.007594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:52.008128 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:52.008559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:52.009241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:52.009681 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:52.010144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:52.086121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-30cf03f9-5290-451f-bb5b-c82f7322e451 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088897 Sep 14 19:58:52.086719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 249/502] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 19:58:51 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:52.379039 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-be26d818-77e8-46c7-9a3b-45483195d20d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "POST /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.694711 Sep 14 19:58:52.380160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 254/503] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:58:50 2022] POST /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7/os-volume_attachments => generated 194 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:52.554945 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:52.555558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:52.561461 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:52.561991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:52.562426 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:52.563126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:52.563576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:52.563991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:52.579735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=100 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:58:52.710330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:52.718666 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b03e4e35-c5f7-4291-b141-33706ec60af2 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.168136 Sep 14 19:58:52.719234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 250/504] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:52 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:53.086747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-e30132b3-3582-4d55-8f62-3385186f5c7e req-895ff743-b590-459b-9e40-46f9345a02d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75fbf44-86a1-4b99-97a3-d7e04415ac72", "tag": "ae006861-47e1-449b-b3aa-d229e77ec13d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:53.098187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-e30132b3-3582-4d55-8f62-3385186f5c7e req-895ff743-b590-459b-9e40-46f9345a02d7 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:53.098796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-e30132b3-3582-4d55-8f62-3385186f5c7e req-895ff743-b590-459b-9e40-46f9345a02d7 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:53.099322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-e30132b3-3582-4d55-8f62-3385186f5c7e req-895ff743-b590-459b-9e40-46f9345a02d7 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:53.112096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-e30132b3-3582-4d55-8f62-3385186f5c7e req-895ff743-b590-459b-9e40-46f9345a02d7 service nova] Creating event network-changed:ae006861-47e1-449b-b3aa-d229e77ec13d for instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 on hv-cinder-83976 Sep 14 19:58:53.118570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-e30132b3-3582-4d55-8f62-3385186f5c7e req-895ff743-b590-459b-9e40-46f9345a02d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038566 Sep 14 19:58:53.119501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 255/505] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:58:53.746188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:53.747654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:53.756538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:53.757143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:53.757659 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:53.758549 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:53.759106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:53.759606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:53.984849 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:53.994159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-341779fd-6121-414f-9faa-4bd61ebd9e3f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.255846 Sep 14 19:58:53.994741 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 251/506] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:53 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:55.018919 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:55.019618 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:55.026375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:55.026857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:55.027338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:55.028022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:55.028468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:55.028891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:55.177358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:55.185519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4773377b-713c-41ea-b5ca-32983a9adb4d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.171009 Sep 14 19:58:55.186120 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 256/507] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:55 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:56.209051 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:56.209670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:56.216272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:56.216764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:56.217205 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:56.217952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:56.218408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:56.218832 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:56.387445 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:56.396301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-dd615636-82c5-4d05-80c0-6ad38b701637 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.191752 Sep 14 19:58:56.396873 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 252/508] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:56 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:57.419637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:57.420245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:57.427607 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:57.436234 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:57.436234 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:57.436234 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:57.436234 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:57.436656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:57.529011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:57.529520 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:57.536602 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:57.537090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:57.537520 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:57.538273 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:57.538727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:57.539151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:57.564039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c8f80dbd-f8d3-428c-aa2f-22737d5161cf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/ips" status: 200 len: 148 microversion: 2.1 time: 0.038831 Sep 14 19:58:57.564644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 253/509] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 19:58:57 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:58:57.572808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:57.581347 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b9ab77c9-3b61-4152-8d78-3147eeb912b1 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.165517 Sep 14 19:58:57.581933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 257/510] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:57 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:58.605162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:58.605764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:58.612209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:58.612682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:58.613109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:58.614370 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:58.614816 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:58.615236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:58.753600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:58.762486 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1236227b-1a97-471d-b71c-d2dec94b62f8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.161279 Sep 14 19:58:58.763056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 254/511] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:58 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:58:59.350123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2913a6d-452f-4f96-9c92-dbf3a567685c"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:58:59.352553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:59.359233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:59.359720 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:59.360158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:59.360886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:59.361345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:59.361772 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:59.784608 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:58:59.785503 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:58:59.792211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:59.792696 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:59.793133 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:59.793847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:58:59.794301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:58:59.794729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:58:59.942333 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:58:59.950559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-39ce1600-2d99-42eb-adb3-a0e641f3e60b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.169912 Sep 14 19:58:59.951147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 255/512] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:58:59 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:00.578850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-db22cea1-81ae-4150-a395-fce0b5579569 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.233113 Sep 14 19:59:00.579393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 258/513] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:58:59 2022] POST /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments => generated 194 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:00.975266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:00.975914 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:00.982263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:00.982748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:00.983186 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:00.983878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:00.984328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:00.984748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:01.124168 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:01.133003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9eed3c0b-4218-4463-976e-f0b8d46b5458 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.162128 Sep 14 19:59:01.133569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 256/514] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:00 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:02.158729 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:02.159481 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:02.166112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:02.166596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:02.167032 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:02.167723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:02.168170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:02.168644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:02.314210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:02.322572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ac988341-6e8b-4ebc-824c-75fec7dc0f9d tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.168753 Sep 14 19:59:02.323135 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 259/515] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:02 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:03.347215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:03.348557 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:03.355062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:03.355546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:03.356011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:03.356701 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:03.357151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:03.357579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:03.499291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:03.507703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7ef92ca5-3412-43b4-b45e-3da5d22107c7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.164441 Sep 14 19:59:03.510777 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 257/516] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:03 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:04.531634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:04.532175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:04.539274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:04.539793 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:04.540269 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:04.540954 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:04.541400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:04.541880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:04.683682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:04.691922 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-80ac0586-5de3-4fb7-9ad8-416cbdc529f0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.164249 Sep 14 19:59:04.692495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 260/517] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:04 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:05.715805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:05.716458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:05.722810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:05.723285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:05.723715 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:05.724395 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:05.724838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:05.725255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:05.870995 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:05.879620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-45a92057-5991-4f33-b76c-972d93784153 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1754 microversion: 2.1 time: 0.167669 Sep 14 19:59:05.880196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 258/518] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:05 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:06.903026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:06.903637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:06.910195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:06.916617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:06.916617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:06.916617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:06.916617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:06.916982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:07.054449 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:07.062582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e5cc594a-a251-4629-929d-308581af4fff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1757 microversion: 2.1 time: 0.163440 Sep 14 19:59:07.063143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 261/519] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:06 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:12.375902 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e7bddf97-53c0-49e7-888e-a7a98a9be5f3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: .version_select at 0x7f19e5783550>, body: {"keypair": {"name": "tempest-keypair-299282960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhROkz5FFvVeYck9yRfFgIy892bYqrd6skWt7dOulJOHqK6tofB0G4RSoinsGQuMtaJvpWkoUqRf5ycTrPJQpOcBa74VVHoEDVGgdE0Ov8CyYhJXTdXMsjIZHHTd8Mrlw=="}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:12.382499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=53 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:12.393237 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-e7bddf97-53c0-49e7-888e-a7a98a9be5f3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:59:12.397002 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-e7bddf97-53c0-49e7-888e-a7a98a9be5f3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:59:12.517432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e7bddf97-53c0-49e7-888e-a7a98a9be5f3 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145221 Sep 14 19:59:12.518117 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 259/520] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 19:59:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:14.902019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1817456760", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdcbc0df-73f5-4094-bf95-288827ed92e6"}], "security_groups": [{"name": "tempest-securitygroup--1102954606"}], "key_name": "tempest-keypair-299282960", "user_data": "}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:15.015359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] validate_networks() for [('fdcbc0df-73f5-4094-bf95-288827ed92e6', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:59:15.375057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:59:15.375569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:59:15.376008 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:59:15.376410 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:59:15.376817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:59:15.386195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:15.391015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:15.391015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:15.391015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:15.391015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:15.391330 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:15.404937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:59:15.408797 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:59:15.420073 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:59:15.422359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:59:15.755751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6ee36a13-9063-4804-946c-43d21590603b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.858136 Sep 14 19:59:15.756479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 262/521] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:59:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:59:15.768659 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-dc7c6bd0-73e9-4226-b177-a689c4f5baab tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:15.769409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-dc7c6bd0-73e9-4226-b177-a689c4f5baab tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:15.829875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-dc7c6bd0-73e9-4226-b177-a689c4f5baab tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:15.837510 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-dc7c6bd0-73e9-4226-b177-a689c4f5baab tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1241 microversion: 2.1 time: 0.073528 Sep 14 19:59:15.838119 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 260/522] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:15 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:16.861226 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:16.861861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:16.868164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:16.868652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:16.869089 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:16.869789 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:16.870291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:16.870720 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:16.939069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:16.947275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-19d8286d-ac36-4159-97fd-87cdc17f5ca6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1245 microversion: 2.1 time: 0.090677 Sep 14 19:59:16.947832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 263/523] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:16 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:17.970924 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:17.971478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:17.973791 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=49 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:17.979050 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:17.979526 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:17.979953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:17.980633 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:17.981080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:17.981497 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:18.044116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:18.052117 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-08103a4d-d510-4f17-8ea3-09677ffb10c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1293 microversion: 2.1 time: 0.084934 Sep 14 19:59:18.052678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 261/524] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:17 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:19.074596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:19.075208 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:19.077883 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:19.082567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:19.083047 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:19.083480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:19.084171 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:19.084663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:19.085088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:19.088978 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:19.223631 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:19.231797 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-911e60d7-e967-4f17-b624-76c7627f6c7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.161085 Sep 14 19:59:19.232401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 264/525] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:19 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:19.592197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:19.592737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:19.599658 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:19.600142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:19.600599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:19.601288 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:19.601730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:19.602177 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:19.725412 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lazy-loading 'services' on Instance uuid d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:59:19.980489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-22ad54f4-eb94-4836-8e20-4a57dbb9b658 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7/os-volume_attachments/5b13adf6-ead6-45f1-922b-3ef443cdaaa1" status: 202 len: 0 microversion: 2.1 time: 0.392387 Sep 14 19:59:19.981201 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 262/526] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 19:59:19 2022] DELETE /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7/os-volume_attachments/5b13adf6-ead6-45f1-922b-3ef443cdaaa1 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:59:20.099491 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-4bd68765-5015-4442-8288-cf900e9615bb req-7ea288c9-adc1-4094-ae66-3acc020dc12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55857d3-b341-41f5-b675-dcb6b621d7a6", "tag": "f197bca5-7df1-4f79-9a38-365a80094434"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:20.113042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4bd68765-5015-4442-8288-cf900e9615bb req-7ea288c9-adc1-4094-ae66-3acc020dc12e service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:20.113532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4bd68765-5015-4442-8288-cf900e9615bb req-7ea288c9-adc1-4094-ae66-3acc020dc12e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:20.114587 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4bd68765-5015-4442-8288-cf900e9615bb req-7ea288c9-adc1-4094-ae66-3acc020dc12e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:20.126234 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-4bd68765-5015-4442-8288-cf900e9615bb req-7ea288c9-adc1-4094-ae66-3acc020dc12e service nova] Creating event network-changed:f197bca5-7df1-4f79-9a38-365a80094434 for instance e55857d3-b341-41f5-b675-dcb6b621d7a6 on hv-cinder-83976 Sep 14 19:59:20.131564 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-4bd68765-5015-4442-8288-cf900e9615bb req-7ea288c9-adc1-4094-ae66-3acc020dc12e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037325 Sep 14 19:59:20.132165 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 265/527] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:59:20.256315 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:20.259865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:20.263404 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:20.263953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:20.264327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:20.265015 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:20.265466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:20.265931 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:20.396002 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:20.403522 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ef511958-d66f-4a91-8a9c-ddf44c5ece68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.151496 Sep 14 19:59:20.404085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 263/528] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:20 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:21.427573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:21.428293 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:21.435121 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:21.435620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:21.439739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:21.439739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:21.439739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:21.439739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:21.565459 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:21.573614 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-31550712-a8ae-452e-95f6-cb6ad542e046 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.150482 Sep 14 19:59:21.574208 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 266/529] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:21 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:22.163770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:22.164263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:22.170544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:22.171020 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:22.171450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:22.174303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:22.174303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:22.174303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:22.201307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 19:59:22.427227 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ccedd30a-7af6-41a5-9427-d2fe453614d0 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 204 len: 0 microversion: 2.1 time: 0.266706 Sep 14 19:59:22.427735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 264/530] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 19:59:22 2022] DELETE /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 19:59:22.436485 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:22.437716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:22.444123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:22.444610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:22.445046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:22.445739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:22.446225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:22.446643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:22.576817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:22.585171 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-52e064f1-5a12-440d-b7b3-81db1ac7a246 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1513 microversion: 2.1 time: 0.152522 Sep 14 19:59:22.585729 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 267/531] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:22 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:22.597331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:22.598798 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:22.604756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:22.605237 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:22.605673 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:22.606387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:22.606839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:22.607262 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:22.735054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:22.743046 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c8098352-d6d6-40da-9f81-97b9a5a3566b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.150340 Sep 14 19:59:22.743614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 265/532] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:22 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:23.608403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:23.609018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:23.615441 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:23.615917 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:23.616352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:23.617033 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:23.617486 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:23.617944 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:23.747944 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:23.756160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-99d118af-fc38-40a5-9a54-8eefdcda1b10 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1513 microversion: 2.1 time: 0.151609 Sep 14 19:59:23.756757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 268/533] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:23 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:23.766232 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:23.767016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:23.774881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:23.775378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:23.775826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:23.776561 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:23.777022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:23.777453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:23.909016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:23.916602 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f68a0a7c-1087-441f-a7e4-fc9f7ef833a9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.154243 Sep 14 19:59:23.917173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 266/534] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:23 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:24.779337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:24.779950 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:24.786502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:24.786986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:24.787422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:24.788108 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:24.788561 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:24.788986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:24.920391 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:24.928647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8e6fbc42-bac9-41c2-a2e9-8dfc2d64c7e4 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1513 microversion: 2.1 time: 0.153136 Sep 14 19:59:24.929196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 269/535] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:24 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:24.940342 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:24.940960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:24.947913 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:24.948394 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:24.948826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:24.949508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:24.949989 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:24.950412 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:25.076711 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:25.084912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-166fe0d0-5c92-4e30-9ad8-8b1e14eac0f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.148426 Sep 14 19:59:25.085490 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 267/536] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:24 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:25.437393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-8b1bf05a-ca12-4137-91bf-62d77feb440e req-8c8f4431-8a8a-45b1-bb1c-da56852b1f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55857d3-b341-41f5-b675-dcb6b621d7a6", "name": "network-vif-plugged", "status": "completed", "tag": "f197bca5-7df1-4f79-9a38-365a80094434"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:25.442475 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:25.443145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=6 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:25.448311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-8b1bf05a-ca12-4137-91bf-62d77feb440e req-8c8f4431-8a8a-45b1-bb1c-da56852b1f46 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:25.449173 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-8b1bf05a-ca12-4137-91bf-62d77feb440e req-8c8f4431-8a8a-45b1-bb1c-da56852b1f46 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:25.449294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-8b1bf05a-ca12-4137-91bf-62d77feb440e req-8c8f4431-8a8a-45b1-bb1c-da56852b1f46 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:25.460605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-8b1bf05a-ca12-4137-91bf-62d77feb440e req-8c8f4431-8a8a-45b1-bb1c-da56852b1f46 service nova] Creating event network-vif-plugged:f197bca5-7df1-4f79-9a38-365a80094434 for instance e55857d3-b341-41f5-b675-dcb6b621d7a6 on hv-cinder-83976 Sep 14 19:59:25.465544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-8b1bf05a-ca12-4137-91bf-62d77feb440e req-8c8f4431-8a8a-45b1-bb1c-da56852b1f46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031970 Sep 14 19:59:25.466322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 270/537] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:25.952061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:25.952901 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:25.955156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=6 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:25.960927 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:25.961414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:25.961872 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:25.962566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:25.963014 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:25.963437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:26.109257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:26.109975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:26.116948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:26.117510 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:26.118038 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:26.118830 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:26.119282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:26.119704 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:26.127163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:26.132163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-44d7ccdf-2b58-4b63-8512-c30a0b7d5fea tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1513 microversion: 2.1 time: 0.183974 Sep 14 19:59:26.133713 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 268/538] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:25 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:26.247448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-a69b4972-b86b-4001-a31e-e5e86af5e737 req-78c59545-03da-48bf-a963-f6a828b7b19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3389de1-2a95-4ab4-b206-8bf1c5c05bd7", "name": "network-vif-deleted", "tag": "19fb278e-4135-4992-9eae-b30c639eea88"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:26.257907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a69b4972-b86b-4001-a31e-e5e86af5e737 req-78c59545-03da-48bf-a963-f6a828b7b19b service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:26.264684 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a69b4972-b86b-4001-a31e-e5e86af5e737 req-78c59545-03da-48bf-a963-f6a828b7b19b service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:26.264684 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a69b4972-b86b-4001-a31e-e5e86af5e737 req-78c59545-03da-48bf-a963-f6a828b7b19b service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:26.265042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:26.269984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2ba2ffb9-cb46-4e07-8346-569ca253ef47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.165706 Sep 14 19:59:26.270488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 271/539] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:26 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:26.270612 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-a69b4972-b86b-4001-a31e-e5e86af5e737 req-78c59545-03da-48bf-a963-f6a828b7b19b service nova] Creating event network-vif-deleted:19fb278e-4135-4992-9eae-b30c639eea88 for instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 on hv-cinder-83976 Sep 14 19:59:26.275314 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-a69b4972-b86b-4001-a31e-e5e86af5e737 req-78c59545-03da-48bf-a963-f6a828b7b19b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Sep 14 19:59:26.276242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 269/540] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:59:27.155400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:27.156007 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:27.163064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:27.163544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:27.163980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:27.164666 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:27.165147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:27.165569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:27.196398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:27.196889 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:27.197331 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:27.197775 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lazy-loading 'fault' on Instance uuid d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:59:27.241576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:27.249369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-73cc522b-e57a-4b2d-9305-d263590ed0a8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1309 microversion: 2.1 time: 0.097801 Sep 14 19:59:27.249966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 272/541] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:27 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:27.294011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:27.294737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:27.300831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:27.301359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:27.301744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:27.302448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:27.302896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:27.303316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:27.438539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:27.447054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-cbb5cd44-d8f4-416a-ba09-af18370480cd tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1367 microversion: 2.1 time: 0.157806 Sep 14 19:59:27.447616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 270/542] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:27 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:28.272043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:28.272649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:28.279020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:28.279500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:28.279932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:28.280603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:28.281056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:28.281472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:28.311053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:28.311516 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:28.311946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:28.312383 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lazy-loading 'fault' on Instance uuid d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:59:28.355070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:28.362639 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0a654410-eb11-4edd-8194-7f64a6d4ba3d tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 200 len: 1309 microversion: 2.1 time: 0.095004 Sep 14 19:59:28.363201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 273/543] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:28 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:28.470862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:28.471473 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:28.478560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:28.479109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:28.479552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:28.480247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:28.480701 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:28.481151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:28.613714 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:28.622285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-11e0d33b-3f66-494b-bf56-cda91ab18dc7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1557 microversion: 2.1 time: 0.155329 Sep 14 19:59:28.622837 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 271/544] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:28 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:28.648105 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:28.648604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:28.654573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:28.655058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:28.655490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:28.656175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:28.656723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:28.657222 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:28.734570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1a1b0559-305a-43a0-ae65-822079b90dc5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090811 Sep 14 19:59:28.735195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 274/545] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 19:59:28 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:29.385371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:29.386022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: d3389de1-2a95-4ab4-b206-8bf1c5c05bd7] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:29.391885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:29.392376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:29.392812 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:29.393507 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:29.394013 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:29.394454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:29.407648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] HTTP exception thrown: Instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 could not be found. Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Request method failure captured: Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 HTTP/1.1 Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjI-GCwEqvYX7VKXLYESFQtkjULMXWodHp3JeoUN5b6Gp6DQk22--hZ_tOzEPELb3BzbUxFHe53FTZX1TtyIGDfJhYT-5O8AGTzZ6m03lEEE2xEWb-wmVqk6OLyiyOPPSTnyW3c9dYMGbnIGTz9E0kDbfTPBQaguFE0ZQW-si-isPA4 Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: bb2e9dd680194d6e9b861fed73188ba6 Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesSnapshotTestJSON-204134938 Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 19:59:29.409325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb2e9dd680194d6e9b861fed73188ba6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb2e9dd680194d6e9b861fed73188ba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb2e9dd680194d6e9b861fed73188ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb2e9dd680194d6e9b861fed73188ba6"}]}] Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesSnapshotTestJSON-204134938 Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: bb2e9dd680194d6e9b861fed73188ba6 Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-204134938 Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesSnapshotTestJSON-204134938-project Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: a66d0ec3a156469980551f9bc9034d4e Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesSnapshotTestJSON-204134938-project Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 could not be found. Sep 14 19:59:29.411110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'd3389de1-2a95-4ab4-b206-8bf1c5c05bd7'} Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 could not be found. Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 19:59:29.411954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 could not be found. Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 could not be found. Sep 14 19:59:29.413506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 19:59:29.414863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Returning 404 to user: Instance d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 19:59:29.414863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-10c4d976-c50f-4a92-bd3b-a28939698e24 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7" status: 404 len: 111 microversion: 2.1 time: 0.029446 Sep 14 19:59:29.414863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 272/546] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:29 2022] GET /compute/v2.1/servers/d3389de1-2a95-4ab4-b206-8bf1c5c05bd7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 19:59:29.946996 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-fc846ad9-4201-4264-a61d-2e15b4ed9328 req-7cbad20f-eab9-451d-814d-f4b41d795ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55857d3-b341-41f5-b675-dcb6b621d7a6", "tag": "f197bca5-7df1-4f79-9a38-365a80094434"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:29.956556 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-fc846ad9-4201-4264-a61d-2e15b4ed9328 req-7cbad20f-eab9-451d-814d-f4b41d795ecf service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:29.957037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-fc846ad9-4201-4264-a61d-2e15b4ed9328 req-7cbad20f-eab9-451d-814d-f4b41d795ecf service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:29.957495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-fc846ad9-4201-4264-a61d-2e15b4ed9328 req-7cbad20f-eab9-451d-814d-f4b41d795ecf service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:29.968508 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-fc846ad9-4201-4264-a61d-2e15b4ed9328 req-7cbad20f-eab9-451d-814d-f4b41d795ecf service nova] Creating event network-changed:f197bca5-7df1-4f79-9a38-365a80094434 for instance e55857d3-b341-41f5-b675-dcb6b621d7a6 on hv-cinder-83976 Sep 14 19:59:29.974338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-fc846ad9-4201-4264-a61d-2e15b4ed9328 req-7cbad20f-eab9-451d-814d-f4b41d795ecf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030700 Sep 14 19:59:29.976513 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 275/547] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:30.842782 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:30.843279 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:30.850081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:30.850578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:30.851021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:30.851722 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:30.852173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:30.852595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:30.938823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'services' on Instance uuid f70804c4-376b-4606-bd6f-4414c9892629 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:59:31.214703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-63f766bb-c2b7-452e-b34e-a867baec126e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-volume_attachments/0ae48e5b-39cf-4f61-862c-1733f61aa063" status: 202 len: 0 microversion: 2.1 time: 0.375609 Sep 14 19:59:31.215294 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 273/548] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 19:59:30 2022] DELETE /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-volume_attachments/0ae48e5b-39cf-4f61-862c-1733f61aa063 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:59:34.450482 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-89f2196f-6763-4e86-9aec-8cae483a0127 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:34.457421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f2196f-6763-4e86-9aec-8cae483a0127 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:34.458660 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f2196f-6763-4e86-9aec-8cae483a0127 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:34.459095 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f2196f-6763-4e86-9aec-8cae483a0127 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:34.483626 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-89f2196f-6763-4e86-9aec-8cae483a0127 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Going to try to stop instance {{(pid=132861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 19:59:34.742861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-89f2196f-6763-4e86-9aec-8cae483a0127 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action" status: 202 len: 0 microversion: 2.1 time: 0.296313 Sep 14 19:59:34.743405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 276/549] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:59:34 2022] POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:59:34.752464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:34.753159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:34.760153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:34.760641 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:34.761069 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:34.761821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:34.762272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:34.762907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:34.895868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:34.902643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-59ef77fa-6299-4dfd-b0ce-5809c0b32c22 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.154839 Sep 14 19:59:34.903207 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 274/550] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:34 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:35.927730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:35.928422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:35.934639 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:35.935154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:35.935604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:35.936322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:35.936826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:35.937251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:36.067634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:36.075429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-91f47fed-d9ab-49cf-956c-e7457f1348b7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.152877 Sep 14 19:59:36.075926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 277/551] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:35 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:37.098789 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:37.099395 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:37.105889 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:37.106365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:37.106794 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:37.107469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:37.107915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:37.108334 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:37.237931 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:37.242023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:37.246405 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e6e24493-3635-45b5-8357-d7bb3b6d7bd1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.151475 Sep 14 19:59:37.246966 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 275/552] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:37 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:38.268784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:38.269338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:38.276616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:38.277103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:38.277541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:38.278259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:38.278714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:38.279141 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:38.403587 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:38.411445 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-af4c55f1-9cc5-4130-b747-7919129872bd tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.146574 Sep 14 19:59:38.412013 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 278/553] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:38 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:39.435030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:39.435640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:39.442452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:39.442943 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:39.443379 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:39.444063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:39.444514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:39.444939 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:39.572159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:39.580038 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4abdf8b3-009c-4448-ab28-55d47a414acb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.148939 Sep 14 19:59:39.580601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 276/554] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:39 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:40.063749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1371904237", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "networks": [{"uuid": "5d93a901-9188-457f-993b-66c28d3f5aed"}]}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:40.117203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] validate_networks() for [('5d93a901-9188-457f-993b-66c28d3f5aed', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 19:59:40.454918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 19:59:40.455338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 19:59:40.455807 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 19:59:40.456212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 19:59:40.456664 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 19:59:40.466092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:40.466569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:40.467000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:40.467719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:40.468169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:40.468590 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:40.484747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Getting quotas for project bb2e9dd680194d6e9b861fed73188ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 19:59:40.488596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Getting quotas for user a66d0ec3a156469980551f9bc9034d4e and project bb2e9dd680194d6e9b861fed73188ba6. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 19:59:40.499321 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 19:59:40.501541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 19:59:40.602578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:40.603184 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:40.609595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:40.610110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:40.610544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:40.611221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:40.611671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:40.612093 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:40.672588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-85796e55-dcf6-47fc-8687-0efaf86afd79 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612563 Sep 14 19:59:40.673413 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 279/555] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 19:59:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 19:59:40.684644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-35dded6d-fa3a-41b7-9479-441ef99bc2e9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:40.685250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-35dded6d-fa3a-41b7-9479-441ef99bc2e9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:40.746473 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:40.755375 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-90515a19-5e23-45d1-9ab8-e9a8193e6277 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.155942 Sep 14 19:59:40.755868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-35dded6d-fa3a-41b7-9479-441ef99bc2e9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:40.763302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-35dded6d-fa3a-41b7-9479-441ef99bc2e9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1219 microversion: 2.1 time: 0.082355 Sep 14 19:59:40.764040 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 280/556] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:40 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:40.771662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 277/557] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:40 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:41.779042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:41.779586 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:41.785384 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:41.786050 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:41.786158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:41.786589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:41.787041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:41.787724 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:41.788180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:41.788606 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:41.792294 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:41.792781 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:41.793209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:41.793916 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:41.794363 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:41.794782 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:41.860310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:41.868709 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-662bee49-7aec-4e49-931a-85c849a7a909 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1223 microversion: 2.1 time: 0.086506 Sep 14 19:59:41.869151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 278/558] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:41 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:41.924951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:41.933351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-262e8a32-0e14-42ca-bdff-757425327512 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.158277 Sep 14 19:59:41.933936 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 281/559] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:41 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:42.890814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:42.891454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:42.893749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:42.898505 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:42.899017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:42.899453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:42.900182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:42.900634 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:42.901053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:42.955936 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:42.956648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:42.962744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:42.963845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:42.964336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:42.964770 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:42.965468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:42.966152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:42.970783 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:42.970920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9e68bbac-b7ac-429a-ab82-7e45a61d65bf tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1271 microversion: 2.1 time: 0.083752 Sep 14 19:59:42.971669 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 279/560] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:42 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:43.093584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:43.101161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b6b36205-aad2-4805-8447-cce865e3b110 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.149470 Sep 14 19:59:43.101711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 282/561] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:42 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:43.994424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:43.995069 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:44.002565 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:44.003033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:44.003471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:44.004172 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:44.004631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:44.005052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:44.126515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:44.127126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:44.134344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:44.134833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:44.135269 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:44.135994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:44.136622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:44.137328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:44.141241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:44.191146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:44.202850 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-552e3d1f-f4af-42d4-8cc6-102426893975 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.211996 Sep 14 19:59:44.213900 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 280/562] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:43 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:44.308126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:44.316444 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-26b9d69a-b849-440a-94fc-92b5435823f3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.195523 Sep 14 19:59:44.317100 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 283/563] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:44 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:44.955295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-939c22e7-ae0f-4edd-866a-4efe5c16327b req-9f2ef870-6fdd-4030-b068-5b55bfbdc255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207f0ea6-84c0-497d-9c93-55314ce8128a", "tag": "a5529312-e1f4-4ca3-a519-65bc110189b5"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:44.965392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-939c22e7-ae0f-4edd-866a-4efe5c16327b req-9f2ef870-6fdd-4030-b068-5b55bfbdc255 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:44.965895 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-939c22e7-ae0f-4edd-866a-4efe5c16327b req-9f2ef870-6fdd-4030-b068-5b55bfbdc255 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:44.967673 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-939c22e7-ae0f-4edd-866a-4efe5c16327b req-9f2ef870-6fdd-4030-b068-5b55bfbdc255 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:44.980152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-939c22e7-ae0f-4edd-866a-4efe5c16327b req-9f2ef870-6fdd-4030-b068-5b55bfbdc255 service nova] Creating event network-changed:a5529312-e1f4-4ca3-a519-65bc110189b5 for instance 207f0ea6-84c0-497d-9c93-55314ce8128a on hv-cinder-83976 Sep 14 19:59:44.986179 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-939c22e7-ae0f-4edd-866a-4efe5c16327b req-9f2ef870-6fdd-4030-b068-5b55bfbdc255 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034343 Sep 14 19:59:44.986932 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 281/564] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:45.226721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:45.227333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:45.234792 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:45.235287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:45.235727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:45.236425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:45.236880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:45.237305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:45.340133 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:45.340819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:45.347808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:45.348301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:45.348733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:45.349437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:45.349906 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:45.350328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:45.383167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:45.391071 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2635000d-4cf1-4b4a-9c93-a47eaaae9b82 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.168118 Sep 14 19:59:45.391613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 284/565] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:45 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:45.517242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:45.526985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3d0bcb28-d758-4d3a-94ae-c7b838725f8f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.190962 Sep 14 19:59:45.527769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 282/566] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:45 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:46.413864 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:46.414457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:46.420847 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:46.421331 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:46.421766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:46.422476 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:46.422932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:46.423358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:46.552631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:46.553112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:46.553274 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:46.559912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:46.560424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:46.560829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-54197041-feb5-4e8e-a201-b7fb2fec9def tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.151362 Sep 14 19:59:46.560938 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:46.561448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 285/567] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:46 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:46.561562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:46.562013 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:46.562439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:46.688399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:46.696601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f7e9628f-5fad-4a6e-a5e5-b4003dd4c751 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.148332 Sep 14 19:59:46.697175 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 283/568] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:46 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:47.584912 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:47.584912 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:47.590543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:47.591029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:47.591465 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:47.592154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:47.592610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:47.593036 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:47.719935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:47.729476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:47.729476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:47.729476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:47.729920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:47.730627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:47.731211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:47.731987 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:47.734083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:47.743129 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-48efe3a8-9aad-4300-849e-8a8d389f74b1 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.163468 Sep 14 19:59:47.743707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 286/569] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:47 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:48.069692 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:48.077283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-dd0dc24f-ac6a-4dc8-8b0e-b0c034889e1f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.361318 Sep 14 19:59:48.078114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 284/570] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:47 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:48.641822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55378e90-0552-41e7-a093-817588dfbc45"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:48.644280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:48.652352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:48.652887 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:48.653542 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:48.654421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:48.654982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:48.655530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:48.768719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:48.769318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:48.776298 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:48.776961 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:48.778701 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:48.783417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:48.783417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:48.783417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:48.910484 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:48.918253 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-49c1dffd-e0b0-43ff-a062-f5c6a531f9f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.153616 Sep 14 19:59:48.918815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 285/571] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:48 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:49.103307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:49.104006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:49.110336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:49.111960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:49.111960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:49.112162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:49.112682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:49.113140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:49.248800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:49.256439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e460a951-75f8-44f5-a6d7-7052573759bf tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.157131 Sep 14 19:59:49.256993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 286/572] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:49 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:49.419418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-83322010-8c38-4a6a-a62e-2b896161924f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.781378 Sep 14 19:59:49.420311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 287/573] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:59:48 2022] POST /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 19:59:49.941162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:49.941695 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:49.948632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:49.949121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:49.949552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:49.950269 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:49.954078 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:49.954078 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:50.088218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:50.096617 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ffcb7d19-547a-481e-84b4-f5ea04552493 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.159376 Sep 14 19:59:50.097343 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 287/574] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:49 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:50.280625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:50.281250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:50.283212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:50.288103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:50.288636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:50.289076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:50.289766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:50.290254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:50.290683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:50.431985 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:50.440158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bc199ccd-d353-49b2-a90b-220a4c8797a1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1677 microversion: 2.1 time: 0.164337 Sep 14 19:59:50.440717 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 288/575] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:50 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:51.120332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:51.120955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:51.127712 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.128199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.128655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.129407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.130474 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.130898 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.256569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:51.264133 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0ce4cbb2-f2c7-407c-993a-137b36944193 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.147641 Sep 14 19:59:51.264707 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 288/576] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:51 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:51.464152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:51.464806 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:51.466713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:51.467396 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=8 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:51.473683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.474384 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.474910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.475746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.476350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.476891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.560167 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-e864109b-2f3e-4a5a-bf8f-c0882191f024 req-db176e10-cc1d-4b7a-b25f-7242bf7fd717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207f0ea6-84c0-497d-9c93-55314ce8128a", "name": "network-vif-plugged", "status": "completed", "tag": "a5529312-e1f4-4ca3-a519-65bc110189b5"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:51.575539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e864109b-2f3e-4a5a-bf8f-c0882191f024 req-db176e10-cc1d-4b7a-b25f-7242bf7fd717 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.576023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e864109b-2f3e-4a5a-bf8f-c0882191f024 req-db176e10-cc1d-4b7a-b25f-7242bf7fd717 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.576454 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e864109b-2f3e-4a5a-bf8f-c0882191f024 req-db176e10-cc1d-4b7a-b25f-7242bf7fd717 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.589198 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-e864109b-2f3e-4a5a-bf8f-c0882191f024 req-db176e10-cc1d-4b7a-b25f-7242bf7fd717 service nova] Creating event network-vif-plugged:a5529312-e1f4-4ca3-a519-65bc110189b5 for instance 207f0ea6-84c0-497d-9c93-55314ce8128a on hv-cinder-83976 Sep 14 19:59:51.593994 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-e864109b-2f3e-4a5a-bf8f-c0882191f024 req-db176e10-cc1d-4b7a-b25f-7242bf7fd717 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037687 Sep 14 19:59:51.594761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 289/577] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:51.632648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:51.640464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-36b2db8f-d24c-439d-a6ec-6ed99ac55de7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1654 microversion: 2.1 time: 0.180138 Sep 14 19:59:51.641029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 289/578] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:51 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1654 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:51.663790 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4d3a1b9d-1f9f-4b81-b2bf-6aa30a7f257a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:51.669945 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b9d-1f9f-4b81-b2bf-6aa30a7f257a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.675751 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b9d-1f9f-4b81-b2bf-6aa30a7f257a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.675751 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d3a1b9d-1f9f-4b81-b2bf-6aa30a7f257a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.735175 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4d3a1b9d-1f9f-4b81-b2bf-6aa30a7f257a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Going to try to start instance {{(pid=132862) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 19:59:51.777525 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:51.778055 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:51.784314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.784817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.785294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.786036 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.786484 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.786903 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.819822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0dfb2b26-5444-47dc-ae4d-c6c73787861f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments/edd894a0-a2e1-444c-bd5e-801142e3cf13" status: 200 len: 194 microversion: 2.20 time: 0.046560 Sep 14 19:59:51.820391 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 290/579] 10.222.0.42 () {60 vars in 1454 bytes} [Wed Sep 14 19:59:51 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments/edd894a0-a2e1-444c-bd5e-801142e3cf13 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:59:51.892850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:51.893339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:51.899435 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.899916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.900352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.901038 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.901485 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.901936 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.938503 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4d3a1b9d-1f9f-4b81-b2bf-6aa30a7f257a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action" status: 202 len: 0 microversion: 2.1 time: 0.279224 Sep 14 19:59:51.939037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 290/580] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:59:51 2022] POST /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:59:51.948481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:51.949960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:51.956929 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.957460 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.958061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:51.958874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:51.959442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:51.959952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:52.043975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lazy-loading 'services' on Instance uuid 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:59:52.122976 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:52.132026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d9dc8799-c5e8-49de-b7f5-cad2a37b0934 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1663 microversion: 2.1 time: 0.187943 Sep 14 19:59:52.132754 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 291/581] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:51 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1663 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:52.286779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:52.287430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:52.295430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:52.296103 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:52.299075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:52.299075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:52.299075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:52.299075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:52.327259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9ff34a5d-2510-48cd-9ef7-e1a4db20da67 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments/edd894a0-a2e1-444c-bd5e-801142e3cf13" status: 202 len: 0 microversion: 2.20 time: 0.438179 Sep 14 19:59:52.328408 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 291/582] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Sep 14 19:59:51 2022] DELETE /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments/edd894a0-a2e1-444c-bd5e-801142e3cf13 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 19:59:52.340174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:52.343532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:52.353647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:52.354180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:52.354623 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:52.355333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:52.355788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:52.356228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:52.388082 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e06c63bf-1f78-4161-9054-d86a2d5d4d46 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054831 Sep 14 19:59:52.388685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 292/583] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:52 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:59:52.542112 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:52.545756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:52.554928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2cf16cd1-0f58-47cb-8131-7823e3546e1b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.267227 Sep 14 19:59:52.554928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 292/584] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:52 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:53.155764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:53.156403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:53.163268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:53.163748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:53.164189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:53.164892 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:53.165361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:53.165783 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:53.299315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:53.307087 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-306b6ecc-21e3-413c-a617-5cad61fc2a0a tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1663 microversion: 2.1 time: 0.155233 Sep 14 19:59:53.307654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 293/585] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:53 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:53.402059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:53.404208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:53.411659 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:53.412134 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:53.412564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:53.413252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:53.413700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:53.414144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:53.541391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c906c068-5bda-4bd0-8f6e-832dcd2dfd1c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.143722 Sep 14 19:59:53.541981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 293/586] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:53 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:59:53.572801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:53.573333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:53.579507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:53.579881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:53.580312 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:53.580995 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:53.581443 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:53.581891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:53.713477 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:53.721422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-489dfd20-3ca1-41cc-9269-1cd83f7b63f3 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1319 microversion: 2.1 time: 0.152553 Sep 14 19:59:53.722092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 294/587] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:53 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 19:59:54.330653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:54.331270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:54.337705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.338155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.338589 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:54.339267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.339719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.340140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:54.473621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:54.481442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-99ea48de-68b3-4deb-984b-9399bd26f4d1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1663 microversion: 2.1 time: 0.154877 Sep 14 19:59:54.482037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 294/588] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:54 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:54.554169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:54.556380 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:54.562752 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.563233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.563668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:54.564357 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.564808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.565227 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:54.595243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d330146b-fcfc-4e12-bcf0-bf7676224892 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045098 Sep 14 19:59:54.595794 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 295/589] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:54 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:59:54.743918 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:54.744501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:54.750478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.750963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.751405 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:54.752124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.752582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.753015 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:54.891014 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:54.898642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-76073f3b-e4b1-4684-abd0-e0b52f7ef89a tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1508 microversion: 2.1 time: 0.158700 Sep 14 19:59:54.899194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 295/590] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:54 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:54.920711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44f99a87-be47-4911-9467-54051652d99e", "device": "/dev/sdb"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:54.923068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:54.929412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.929924 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.930364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:54.931050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:54.931503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:54.931927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:55.505187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:55.505960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:55.513450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:55.513966 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:55.514400 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:55.515082 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:55.515528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:55.515947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:55.552687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 19:59:55.651164 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:55.659039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5579c30c-ac4b-4f30-95cb-63dff48b44f5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1663 microversion: 2.1 time: 0.158318 Sep 14 19:59:55.659600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 296/591] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:55 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:55.664832 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:55.667005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:55.672824 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:55.673307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:55.673740 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:55.674491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:55.674930 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:55.675339 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:55.706566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a026e54a-6538-4391-bf5c-6d102c986262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045907 Sep 14 19:59:55.707108 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 297/592] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:55 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:59:55.762623 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d3a4f78a-fc20-43ed-828c-7deb61e6ec0b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "POST /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845671 Sep 14 19:59:55.763256 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 296/593] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 19:59:54 2022] POST /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:56.683479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:56.684089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:56.690442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:56.690923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:56.691357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:56.692035 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:56.692483 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:56.692931 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:56.721322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:56.724189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:56.730899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:56.731386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:56.731824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:56.732530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:56.732983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:56.733409 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:56.763612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a605efb7-4759-4b4f-a8bc-00542fb5ebd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047469 Sep 14 19:59:56.764270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 297/594] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:56 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 19:59:56.825707 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:56.834753 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-aa36f10c-5efb-4472-b0ba-6e3cffc20ac7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1667 microversion: 2.1 time: 0.155080 Sep 14 19:59:56.835457 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 298/595] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:56 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:56.961526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-945011526"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:56.962051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:56.967888 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:56.968372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:56.968809 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:56.969490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:56.969979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:56.970404 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:57.108183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.network.security_group_api [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Removing security group aa56f973-ee43-412a-b7f2-d2d5b44b3fd3 from port 76215690-63a2-4250-9527-2472f8df9b4c Sep 14 19:59:57.524964 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-edc5da3b-79b6-4734-958e-0316cb9dfaaf tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/action" status: 202 len: 0 microversion: 2.1 time: 0.567253 Sep 14 19:59:57.525635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 298/596] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:59:56 2022] POST /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:59:57.533136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-4c27747f-de4b-46e7-b86b-357a38240759 req-8e559cb3-2442-4763-a279-4e94676a4f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254fa332-f087-4923-a1f6-2975e927cc4a", "tag": "76215690-63a2-4250-9527-2472f8df9b4c"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:57.544312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4c27747f-de4b-46e7-b86b-357a38240759 req-8e559cb3-2442-4763-a279-4e94676a4f39 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:57.545199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4c27747f-de4b-46e7-b86b-357a38240759 req-8e559cb3-2442-4763-a279-4e94676a4f39 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:57.545901 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4c27747f-de4b-46e7-b86b-357a38240759 req-8e559cb3-2442-4763-a279-4e94676a4f39 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:57.559705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-4c27747f-de4b-46e7-b86b-357a38240759 req-8e559cb3-2442-4763-a279-4e94676a4f39 service nova] Creating event network-changed:76215690-63a2-4250-9527-2472f8df9b4c for instance 254fa332-f087-4923-a1f6-2975e927cc4a on hv-cinder-83976 Sep 14 19:59:57.565393 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-4c27747f-de4b-46e7-b86b-357a38240759 req-8e559cb3-2442-4763-a279-4e94676a4f39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036762 Sep 14 19:59:57.566493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 299/597] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:57.784520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:57.790394 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:57.797526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:57.798319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:57.798982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:57.799682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:57.800278 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:57.800858 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:57.834461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-21f98a11-fe4f-458a-9b98-2b7b2d4de4c8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058533 Sep 14 19:59:57.835198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 299/598] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:57 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:59:58.064838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:58.067748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:58.076225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:58.076720 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:58.077163 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:58.077928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:58.078384 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:58.079070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:58.103202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'flavor' on Instance uuid c75fbf44-86a1-4b99-97a3-d7e04415ac72 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:59:58.601086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fcde40d5-6936-45a0-b3bb-b77b8f18e99e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/action" status: 200 len: 32 microversion: 2.1 time: 0.541128 Sep 14 19:59:58.612014 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 300/599] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 19:59:58 2022] POST /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 19:59:58.612172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:58.612172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:58.618175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:58.618725 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:58.619342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:58.620041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:58.620499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:58.620925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:58.849257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:58.852005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:58.859302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:58.860144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:58.860676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:58.861479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:58.862120 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:58.862706 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:58.875771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 19:59:58.886895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4731b3e0-518d-4069-b6c2-a449c4de38c0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.279651 Sep 14 19:59:58.887479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 300/600] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:58 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 19:59:58.915515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a05df2b9-fdf1-4333-b68e-bc41a7da98c0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072421 Sep 14 19:59:58.920172 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 301/601] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:58 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 19:59:59.112388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:59.113051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:59.120232 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.120848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.121534 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.122384 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.123061 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.123582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.215913 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lazy-loading 'services' on Instance uuid 254fa332-f087-4923-a1f6-2975e927cc4a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 19:59:59.471918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3f50bd4c-ad87-45f7-b886-16f94dffee2a tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "DELETE /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments/a3b77df1-3f56-46be-a7d5-2144018e7d70" status: 202 len: 0 microversion: 2.1 time: 0.363237 Sep 14 19:59:59.472541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 301/602] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 19:59:59 2022] DELETE /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments/a3b77df1-3f56-46be-a7d5-2144018e7d70 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 19:59:59.483280 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:59.489233 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:59.497016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.497631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.498392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.499331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.499788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.500225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.538205 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4b79961d-7d33-475a-8d57-b9f294c55aaa tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059779 Sep 14 19:59:59.538851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 302/603] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 19:59:59 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:59.585882 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-6a7bc0f4-71cf-46e0-b2c3-74580e4cc23a req-13df212a-ff4d-4221-b902-b26e586f59a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254fa332-f087-4923-a1f6-2975e927cc4a", "tag": "76215690-63a2-4250-9527-2472f8df9b4c"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 19:59:59.596616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-6a7bc0f4-71cf-46e0-b2c3-74580e4cc23a req-13df212a-ff4d-4221-b902-b26e586f59a5 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.596899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-6a7bc0f4-71cf-46e0-b2c3-74580e4cc23a req-13df212a-ff4d-4221-b902-b26e586f59a5 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.597318 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-6a7bc0f4-71cf-46e0-b2c3-74580e4cc23a req-13df212a-ff4d-4221-b902-b26e586f59a5 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.611841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-6a7bc0f4-71cf-46e0-b2c3-74580e4cc23a req-13df212a-ff4d-4221-b902-b26e586f59a5 service nova] Creating event network-changed:76215690-63a2-4250-9527-2472f8df9b4c for instance 254fa332-f087-4923-a1f6-2975e927cc4a on hv-cinder-83976 Sep 14 19:59:59.617073 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-6a7bc0f4-71cf-46e0-b2c3-74580e4cc23a req-13df212a-ff4d-4221-b902-b26e586f59a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035779 Sep 14 19:59:59.617842 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 302/604] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 19:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 19:59:59.912555 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:59.913201 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:59.919626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.920144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.920897 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.921784 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.922413 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.923075 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.928594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 19:59:59.931510 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 19:59:59.937909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.938398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.938860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.939555 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 19:59:59.940170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 19:59:59.940599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 19:59:59.990649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4ece91e4-c243-4c1c-b8b5-cec532f6a2ad tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066795 Sep 14 19:59:59.991901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 303/605] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 19:59:59 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:00.061189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:00.061689 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:00.068586 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:00.070707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:00.071215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:00.072652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:00.073136 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:00.074868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:00.114319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Going to try to terminate instance {{(pid=132861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:00:00.164203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:00.172410 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3b79ae62-a56b-4d86-9f23-3a65d8af739c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.263820 Sep 14 20:00:00.172984 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 303/606] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 19:59:59 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:00.518655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ef2a0c0b-f867-442b-ad82-1dff4d4d1432 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 204 len: 0 microversion: 2.20 time: 0.460741 Sep 14 20:00:00.519293 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 304/607] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 20:00:00 2022] DELETE /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 20:00:00.527561 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:00.528172 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:00.534596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:00.535080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:00.535515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:00.536749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:00.537203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:00.537632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:00.551368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:00.554381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:00.560205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:00.560683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:00.561111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:00.561959 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:00.562324 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:00.562742 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:00.592251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4b7a1a70-c00b-416d-99a6-324d6dc2934b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045061 Sep 14 20:00:00.592818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 305/608] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:00 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:00:00.687421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:00.695469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:00.696917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:00.698091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d6f4ccd7-4df0-4ed5-9752-07d272686309 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.174468 Sep 14 20:00:00.698650 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 304/609] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:00 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:01.196703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:01.201100 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:01.203562 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:01.204300 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:01.204731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:01.205456 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:01.205922 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:01.206350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:01.334850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:01.343020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-13d3099c-68bf-47ad-bc57-ef2c0c53f8fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.150077 Sep 14 20:00:01.343586 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 306/610] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:01 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:01.604726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:01.607063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:01.613584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:01.614599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:01.615031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:01.615703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:01.616145 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:01.616560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:01.645582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-90832d67-de2f-4503-8314-ae23ae6bec6e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Sep 14 20:00:01.646144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 305/611] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:01 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:01.722696 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:01.723287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:01.729201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:01.729680 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:01.730148 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:01.730821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:01.731265 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:01.731679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:01.860625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:01.869177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:01.870640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:01.871779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-14fc18fc-32a0-4350-9b72-ff6d26676a3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.153008 Sep 14 20:00:01.872325 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 307/612] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:01 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:02.365642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:02.366283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:02.372472 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:02.372959 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:02.373399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:02.374131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:02.374587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:02.375028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:02.574289 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:02.583214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bc5251d6-119c-4282-b986-c0544d4f9493 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.220894 Sep 14 20:00:02.583768 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 306/613] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:02 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:02.657987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:02.660175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:02.666676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:02.667151 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:02.667574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:02.668251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:02.668693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:02.669106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:02.698328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-894be6bf-9600-4630-84fb-67e70a35f53f tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Sep 14 20:00:02.699260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 308/614] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:02 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:02.897495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:02.898140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:02.904893 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:02.905389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:02.905852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:02.906575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:02.907028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:02.907457 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:03.291453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:03.299587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:03.301028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:03.302739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-efb1b435-c99e-4b17-8ab6-8c3692d203af tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1724 microversion: 2.20 time: 0.409922 Sep 14 20:00:03.303292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 307/615] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:02 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:03.607376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:03.608008 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:03.614834 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:03.615315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:03.615746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:03.616438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:03.616883 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:03.617306 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:03.715586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:03.715586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:03.726313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:03.726805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:03.727242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:03.727945 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:03.728860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:03.729536 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:03.733912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:03.760066 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7eb3684b-67f9-4cd3-b19a-357defb7ce24 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051894 Sep 14 20:00:03.761314 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 308/616] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:03 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:03.766200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-e3b87b1e-f05b-4f67-b70b-4ac2f9ccfe57 req-7d38e69d-6384-4803-9aeb-6422f63cf81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a", "name": "network-vif-deleted", "tag": "127c779f-5b8f-4922-8168-11cb82065f9b"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:03.775732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:03.776261 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e3b87b1e-f05b-4f67-b70b-4ac2f9ccfe57 req-7d38e69d-6384-4803-9aeb-6422f63cf81d service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:03.776577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e3b87b1e-f05b-4f67-b70b-4ac2f9ccfe57 req-7d38e69d-6384-4803-9aeb-6422f63cf81d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:03.777010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e3b87b1e-f05b-4f67-b70b-4ac2f9ccfe57 req-7d38e69d-6384-4803-9aeb-6422f63cf81d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:03.786714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6a065402-c8ce-455f-abac-f0271b829210 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.182348 Sep 14 20:00:03.789757 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-e3b87b1e-f05b-4f67-b70b-4ac2f9ccfe57 req-7d38e69d-6384-4803-9aeb-6422f63cf81d service nova] Creating event network-vif-deleted:127c779f-5b8f-4922-8168-11cb82065f9b for instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a on hv-cinder-83976 Sep 14 20:00:03.794423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 309/617] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:03 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:03.807091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-e3b87b1e-f05b-4f67-b70b-4ac2f9ccfe57 req-7d38e69d-6384-4803-9aeb-6422f63cf81d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044014 Sep 14 20:00:03.813043 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 309/618] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:04.345882 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:04.345882 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:04.357498 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:04.358037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:04.359867 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:04.360964 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:04.361412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:04.362570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:04.402893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:04.407180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:04.407180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:04.407180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lazy-loading 'fault' on Instance uuid 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:04.451187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:04.460956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:04.462683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:04.464664 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5d3de4a4-bcab-43b8-8c5c-1246d7679d8c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1371 microversion: 2.20 time: 0.128064 Sep 14 20:00:04.465233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 310/619] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:04 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:04.773965 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:04.777342 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:04.784628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:04.785130 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:04.785536 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:04.786432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:04.787090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:04.787826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:04.811483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:04.812096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:04.819536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:04.819865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d73ca935-cdd0-4e84-a960-0bdce36410a7 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050818 Sep 14 20:00:04.820331 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:04.820478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 310/620] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:04 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:04.821059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:04.821973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:04.822589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:04.823181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:04.839321 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:04.975845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:04.984434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-48004a89-19a8-4d80-948c-24f30b0225d5 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.176699 Sep 14 20:00:04.985005 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 311/621] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:04 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:05.490810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:05.491382 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:05.498642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:05.499135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:05.499633 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:05.500293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:05.500729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:05.501154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:05.535611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:05.536100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:05.536552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:05.537160 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lazy-loading 'fault' on Instance uuid 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:05.586355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:05.595135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:05.596877 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:05.597737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f1273c19-8e64-4b58-b8ff-d9d6a7296e2c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 200 len: 1371 microversion: 2.20 time: 0.111932 Sep 14 20:00:05.598471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 311/622] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:05 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:05.832487 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:05.834661 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:05.841018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:05.842033 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:05.842464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:05.843562 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:05.844035 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:05.844480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:05.876099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-db59e411-c8a0-4ef0-944b-e18fda882eb5 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047761 Sep 14 20:00:05.876656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 312/623] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:05 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:06.008717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:06.009328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:06.015635 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:06.016119 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:06.016557 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:06.017238 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:06.017688 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:06.018138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:06.146517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:06.154832 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-afd89b60-afee-4604-b7e6-8026767b3184 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.150287 Sep 14 20:00:06.155407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 312/624] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:06 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:06.623293 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:06.623831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:06.630283 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:06.630762 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:06.631230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:06.632013 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:06.632463 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:06.632883 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:06.646499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] HTTP exception thrown: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Request method failure captured: Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a HTTP/1.1 Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHE7kGcbR3e7IB_4bxxGEt9cUzDCSNZ1QLToLfVFYRq6PRlOEp4-mDKH7_i8_Uaq0af1pK_MrNwX7F1GhFLdVXAjVGtv9d8NNUnaQsXI_nndlSXKNDZsJYfcnRziTTLsPIL8WwybaZTuWIREnGGPxutxTm3Z6fi6_ilPL7vX8SIH7c Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:00:06.648699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdb5ca35665545119e4ca1f379c37a73", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}] Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 2bf1c7a6cc2e4b1294e7b162a8aba738 Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:00:06.650305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a'} Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:06.651156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:00:06.652613 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:06.654354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Returning 404 to user: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:06.654354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-36faf4fa-4f78-4185-8e13-a22d4f3d712c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 404 len: 111 microversion: 2.20 time: 0.030662 Sep 14 20:00:06.654354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 313/625] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:06 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:00:06.659096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b92a8e59-547e-4e38-9051-1897897f227d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '.version_select at 0x7f19e59230d0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:06.748094 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b92a8e59-547e-4e38-9051-1897897f227d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-205498365" status: 204 len: 0 microversion: 2.20 time: 0.092711 Sep 14 20:00:06.748678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 313/626] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Sep 14 20:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-205498365 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 20:00:06.888713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:06.890938 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:06.897775 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:06.905023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:06.905023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:06.905023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:06.905023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:06.905634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:06.940072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-dfc89bbb-f029-40ae-b15f-9d2a08f53383 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055499 Sep 14 20:00:06.940618 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 314/627] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:06 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:07.180257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:07.180872 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:07.187529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:07.189928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:07.189928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:07.189928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:07.189928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:07.190300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:07.410011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:07.419734 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c4fe1311-8cec-4ec3-8f09-222fd4974eb0 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.244406 Sep 14 20:00:07.421697 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 314/628] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:07 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:07.693959 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b678a605-d4b3-468f-920c-fc4fa738663a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'create', calling method: .version_select at 0x7f19e5ba0af0>, body: {"keypair": {"name": "tempest-keypair-459509858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYVAwzcb+G7ZKLAR8rgErmL37nTefxA8lWH009yuhTlmTFzorYJtpcbvZjXoJxojG2J8D5dPXpb404KwCo/kv8uCktfBSLa0GxI7NFQJexTXiN/U4nMRyvbJzjYG0U8Lg=="}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:07.709693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-b678a605-d4b3-468f-920c-fc4fa738663a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for project bdb5ca35665545119e4ca1f379c37a73. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:00:07.713516 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-b678a605-d4b3-468f-920c-fc4fa738663a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for user 2bf1c7a6cc2e4b1294e7b162a8aba738 and project bdb5ca35665545119e4ca1f379c37a73. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:00:07.811019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b678a605-d4b3-468f-920c-fc4fa738663a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.121209 Sep 14 20:00:07.811605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 315/629] 10.222.0.42 () {62 vars in 1200 bytes} [Wed Sep 14 20:00:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 20:00:07.956111 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:07.959073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:07.965311 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:07.966185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:07.966944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:07.967952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:07.968808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:07.969062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:07.998202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a4218dea-4462-4c19-80eb-f109082418ed tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046607 Sep 14 20:00:08.005279 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 315/630] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:07 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 20:00:08.014581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:08.015061 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:08.022140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:08.022614 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:08.023045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:08.023724 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:08.024173 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:08.024630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:08.098932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] HTTP exception thrown: Instance 254fa332-f087-4923-a1f6-2975e927cc4a is not attached to volume a3b77df1-3f56-46be-a7d5-2144018e7d70 Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Request method failure captured: Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: DELETE /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments/a3b77df1-3f56-46be-a7d5-2144018e7d70 HTTP/1.1 Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjH6GRxvMS2NfvA7vSvK7g2Oq_DMq4bEs7Z6UCUCSr3xGqhb3hIy3IK0w06q6nj9yLbmyWs6eP3MRCooy8gwRPvaTk6j-cYhBsNh7oLuEvBlOVgbjDvcrW5PWSKs6GvR-huFzEsRYfr9MDseets7KNVXkCP18l3A7wad951eFub8RFc Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 11fae649642b4703b649d02268bdb4eb Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-TestMinimumBasicScenario-736430707 Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:00:08.101288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11fae649642b4703b649d02268bdb4eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11fae649642b4703b649d02268bdb4eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11fae649642b4703b649d02268bdb4eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11fae649642b4703b649d02268bdb4eb"}]}] Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-TestMinimumBasicScenario-736430707 Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 11fae649642b4703b649d02268bdb4eb Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-TestMinimumBasicScenario-736430707 Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-TestMinimumBasicScenario-736430707-project Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 0ebafc08399c4853959800883742eb78 Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-TestMinimumBasicScenario-736430707-project Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:00:08.102893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 254fa332-f087-4923-a1f6-2975e927cc4a is not attached to volume a3b77df1-3f56-46be-a7d5-2144018e7d70 Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'server_id': '254fa332-f087-4923-a1f6-2975e927cc4a', 'id': 'a3b77df1-3f56-46be-a7d5-2144018e7d70'} Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a3b77df1-3f56-46be-a7d5-2144018e7d70. Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:08.109308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254fa332-f087-4923-a1f6-2975e927cc4a is not attached to volume a3b77df1-3f56-46be-a7d5-2144018e7d70 Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254fa332-f087-4923-a1f6-2975e927cc4a is not attached to volume a3b77df1-3f56-46be-a7d5-2144018e7d70 Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:08.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Returning 404 to user: Instance 254fa332-f087-4923-a1f6-2975e927cc4a is not attached to volume a3b77df1-3f56-46be-a7d5-2144018e7d70 {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:08.113196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-940be451-0a01-401c-bc34-43a834939658 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "DELETE /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments/a3b77df1-3f56-46be-a7d5-2144018e7d70" status: 404 len: 154 microversion: 2.1 time: 0.092269 Sep 14 20:00:08.113196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 316/631] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:00:08 2022] DELETE /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a/os-volume_attachments/a3b77df1-3f56-46be-a7d5-2144018e7d70 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:00:08.445054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:08.445657 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:08.452545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:08.452969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:08.453423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:08.454433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:08.454908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:08.455465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:08.589409 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:08.597489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-74a16796-7796-4776-867c-1dfa2d8e6476 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.156991 Sep 14 20:00:08.598087 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 316/632] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:08 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:09.621330 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:09.622307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:09.632643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:09.632643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:09.632643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:09.632643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:09.633158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:09.633595 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:09.818515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:09.826641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-edfb15ac-df37-4830-8648-7b374006b38e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.209357 Sep 14 20:00:09.827204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 317/633] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:09 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:10.232399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1880380595", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da63156a-ae6e-4671-a212-8f0bbf27ce1b"}], "security_groups": [{"name": "tempest-securitygroup--1922807616"}], "key_name": "tempest-keypair-459509858", "user_data": "}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:10.333292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] validate_networks() for [('da63156a-ae6e-4671-a212-8f0bbf27ce1b', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:00:10.701752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:00:10.702202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:00:10.702671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:00:10.703076 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:00:10.703483 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:00:10.712462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:10.712935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:10.713364 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:10.714119 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:10.714566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:10.714981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:10.731214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for project bdb5ca35665545119e4ca1f379c37a73. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:00:10.735069 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Getting quotas for user 2bf1c7a6cc2e4b1294e7b162a8aba738 and project bdb5ca35665545119e4ca1f379c37a73. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:00:10.746355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:00:10.748601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:00:10.851024 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:10.851743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:10.858470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:10.858968 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:10.859427 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:10.860156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:10.860611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:10.861036 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:10.902352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-088737bf-4828-4348-9646-c5638f7b9dd8 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.674153 Sep 14 20:00:10.903015 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 317/634] 10.222.0.42 () {62 vars in 1188 bytes} [Wed Sep 14 20:00:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 20:00:10.914791 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-83824b1e-6eaa-484a-8c85-c290cfa8c827 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:10.915408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-83824b1e-6eaa-484a-8c85-c290cfa8c827 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:10.923150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:10.974002 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83824b1e-6eaa-484a-8c85-c290cfa8c827 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:10.983121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83824b1e-6eaa-484a-8c85-c290cfa8c827 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:10.984998 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83824b1e-6eaa-484a-8c85-c290cfa8c827 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:10.986220 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-83824b1e-6eaa-484a-8c85-c290cfa8c827 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1281 microversion: 2.20 time: 0.075608 Sep 14 20:00:10.986798 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 318/635] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:10 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:11.008967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:11.019283 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-56dce683-9f32-4622-9155-f85e8f3e900f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.172080 Sep 14 20:00:11.019854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 318/636] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:10 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:11.540737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:11.540737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:11.544378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:11.544850 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:11.545277 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:11.546052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:11.546504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:11.546920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:11.572122 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:00:11.815550 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-08d9631d-1233-4585-94c0-c1d6592a38e4 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "DELETE /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 204 len: 0 microversion: 2.1 time: 0.282935 Sep 14 20:00:11.816148 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 319/637] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:00:11 2022] DELETE /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:00:11.824910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:11.825539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:11.831859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:11.832393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:11.832827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:11.833514 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:11.834615 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:11.835043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:11.961237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:11.968965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-eda338a3-65d4-4cc8-af1d-68f7379f61b0 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.148019 Sep 14 20:00:11.969520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 319/638] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:11 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:12.012578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:12.013272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:12.019146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:12.019625 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:12.020054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:12.020726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:12.021170 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:12.021616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:12.044332 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:12.044943 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:12.050911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:12.051396 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:12.051835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:12.052521 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:12.053473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:12.053927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:12.083057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:12.091372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:12.092811 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:12.094703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-403b09ed-3f4d-493a-b9a4-2aeb4a3abaf4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1285 microversion: 2.20 time: 0.085578 Sep 14 20:00:12.094703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 320/639] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:12 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:12.426692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:12.435712 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4f4e2277-0fdd-4f17-99ef-52379dde27cc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.395175 Sep 14 20:00:12.436305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 320/640] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:12 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:12.992053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:12.992665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:12.999182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:12.999665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:13.000099 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:13.000781 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:13.001238 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:13.001661 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:13.118582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:13.119261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:13.125454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:13.125979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:13.126414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:13.127105 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:13.127557 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:13.127983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:13.134191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.141770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-368eb326-44b3-422c-8e97-2c378148bc8b tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.153637 Sep 14 20:00:13.142381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 321/641] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:12 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:13.187650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.200332 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.202078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.203179 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a8cdc8a0-dcf1-4db4-a66d-63f512e28f1a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1285 microversion: 2.20 time: 0.088558 Sep 14 20:00:13.203740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 321/642] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:13 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:13.458849 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:13.460003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:13.466123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:13.466606 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:13.467053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:13.467727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:13.468176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:13.468597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:13.595117 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:13.603777 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0cd82590-3986-47b4-9171-a9d3dc828082 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.149137 Sep 14 20:00:13.604361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 322/643] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:13 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:14.166369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:14.166938 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:14.173371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:14.173868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:14.174304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:14.174987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:14.175439 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:14.175865 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:14.228923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:14.229552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:14.236229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:14.236714 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:14.237151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:14.237867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:14.238488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:14.238913 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:14.300552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.301109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.308687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-661380b3-6d50-408c-9b2e-5aefe342ce90 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.146739 Sep 14 20:00:14.308844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.309253 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 322/644] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:14 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:14.310871 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.311985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1b51bcb5-4aca-4fc3-8d53-b5625738557b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1285 microversion: 2.20 time: 0.087448 Sep 14 20:00:14.312689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 323/645] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:14 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:14.627530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:14.628130 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:14.634528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:14.635009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:14.635442 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:14.636123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:14.636572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:14.636994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:14.764646 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:14.773319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1be897a4-fa26-43db-84e0-133ef91b3c0c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.149671 Sep 14 20:00:14.773893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 323/646] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:14 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:15.332027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:15.332665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:15.336242 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:15.336847 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:15.339117 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:15.339603 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:15.340041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:15.340731 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:15.341186 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:15.341632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:15.343259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:15.343740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:15.344175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:15.344855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:15.345305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:15.345727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:15.406652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.415243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.416686 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.417770 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d5746eb9-dc99-45cf-8ae7-7960de434376 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1285 microversion: 2.20 time: 0.085386 Sep 14 20:00:15.418374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 324/647] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:15 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:15.473064 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.481121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-546eef3f-13d6-4568-be48-68392e64cdf8 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.153310 Sep 14 20:00:15.481676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 324/648] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:15 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:15.796608 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:15.797210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:15.803045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:15.803535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:15.803963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:15.804639 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:15.805083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:15.805501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:15.935672 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:15.943872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c7d01f53-1bff-487f-9c78-91fded711a80 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.151058 Sep 14 20:00:15.944423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 325/649] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:15 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:16.443067 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:16.443663 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:16.450860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:16.451371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:16.451948 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:16.452651 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:16.453107 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:16.453569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:16.505898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:16.506622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:16.514075 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:16.514720 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:16.515216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:16.520376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:16.520560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:16.520560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:16.520560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:16.523588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:16.525120 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:16.526401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8133a23f-9a2f-48e9-984f-33f7168a91a0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1277 microversion: 2.20 time: 0.087225 Sep 14 20:00:16.527124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 325/650] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:16 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:16.648819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:16.657043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3b2fe923-0fdd-47f2-8fba-883706360271 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.156107 Sep 14 20:00:16.657606 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 326/651] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:16 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:16.967901 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:16.968507 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:16.974749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:16.975239 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:16.975674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:16.976365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:16.976820 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:16.977243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:16.981433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:17.109215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.117173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-45c8ee83-f088-4494-ad8a-5d0ef25430d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.152956 Sep 14 20:00:17.117864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 326/652] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:16 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:17.552019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:17.552624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:17.558988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:17.559774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:17.560000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:17.560688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:17.561136 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:17.561555 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:17.622149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.630300 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.631743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.633319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c7bc84a3-f519-4a72-b560-1537fca10eef tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1333 microversion: 2.20 time: 0.084698 Sep 14 20:00:17.633883 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 327/653] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:17 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:17.680731 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:17.681337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:17.687785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:17.688262 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:17.688691 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:17.689369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:17.689833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:17.690260 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:17.863529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:17.873087 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-070a4c0a-5227-4883-b019-ea043cb7b3ff tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1553 microversion: 2.1 time: 0.196519 Sep 14 20:00:17.874008 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 327/654] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:17 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:18.142207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:18.142843 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:18.144670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:18.149346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:18.149852 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:18.150603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:18.151288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:18.151740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:18.152160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:18.283643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.292419 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-77f71916-c566-48f8-a056-9fe1fff292ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.153821 Sep 14 20:00:18.292948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 328/655] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:18 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:18.387875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-e2912ef6-b2cb-4610-b643-055ae89916b4 req-841675d8-56a6-4999-b0dc-22c0f56dd31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254fa332-f087-4923-a1f6-2975e927cc4a", "name": "network-vif-deleted", "tag": "76215690-63a2-4250-9527-2472f8df9b4c"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:18.398230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e2912ef6-b2cb-4610-b643-055ae89916b4 req-841675d8-56a6-4999-b0dc-22c0f56dd31c service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:18.401425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e2912ef6-b2cb-4610-b643-055ae89916b4 req-841675d8-56a6-4999-b0dc-22c0f56dd31c service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:18.401425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e2912ef6-b2cb-4610-b643-055ae89916b4 req-841675d8-56a6-4999-b0dc-22c0f56dd31c service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:18.412101 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-e2912ef6-b2cb-4610-b643-055ae89916b4 req-841675d8-56a6-4999-b0dc-22c0f56dd31c service nova] Creating event network-vif-deleted:76215690-63a2-4250-9527-2472f8df9b4c for instance 254fa332-f087-4923-a1f6-2975e927cc4a on hv-cinder-83976 Sep 14 20:00:18.417631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-e2912ef6-b2cb-4610-b643-055ae89916b4 req-841675d8-56a6-4999-b0dc-22c0f56dd31c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033495 Sep 14 20:00:18.418374 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 328/656] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:18.660069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:18.660682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:18.663641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:18.669688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:18.677080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:18.677080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:18.677080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:18.677080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:18.677440 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:18.741696 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.744126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:18.752332 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.753896 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.755003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-08ab83a6-76ed-46eb-9ffc-a6b8a2930499 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1333 microversion: 2.20 time: 0.100359 Sep 14 20:00:18.755563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 329/657] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:18 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:18.897530 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:18.898787 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:18.905042 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:18.905468 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:18.905992 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:18.906685 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:18.907156 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:18.907561 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:18.970431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:18.980563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ca5607e1-562d-472c-b736-7962315a6187 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1342 microversion: 2.1 time: 0.087707 Sep 14 20:00:18.981132 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 329/658] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:18 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:19.158470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:19.158930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:19.165250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:19.165759 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:19.166267 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:19.166980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:19.167430 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:19.167860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:19.248339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lazy-loading 'services' on Instance uuid 207f0ea6-84c0-497d-9c93-55314ce8128a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:19.322864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:19.323474 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:19.329438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:19.330223 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:19.330661 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:19.331361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:19.331807 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:19.332232 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:19.501022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-88c3373a-7d27-4a90-a693-fde9450396f9 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "DELETE /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a/os-volume_attachments/44f99a87-be47-4911-9467-54051652d99e" status: 202 len: 0 microversion: 2.1 time: 0.347160 Sep 14 20:00:19.501616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 330/659] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:00:19 2022] DELETE /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a/os-volume_attachments/44f99a87-be47-4911-9467-54051652d99e => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 20:00:19.531831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:19.540528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c9468479-31bc-4847-a64d-2d2b5a1f6f0e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1735 microversion: 2.1 time: 0.222052 Sep 14 20:00:19.541101 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 330/660] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:19 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:19.780994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:19.781637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:19.788343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:19.788822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:19.789254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:19.789967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:19.790421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:19.790845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:19.852714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:19.860734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:19.862213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:19.863293 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1f97a7e5-815c-460b-8b86-42600c9fa340 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1341 microversion: 2.20 time: 0.086665 Sep 14 20:00:19.863844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 331/661] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:19 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:20.006957 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:20.007587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:20.014128 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.014621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.015060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.015752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.016265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.016698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.046733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.047207 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.047645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.048088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lazy-loading 'fault' on Instance uuid 254fa332-f087-4923-a1f6-2975e927cc4a {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:20.100381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:20.111501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b731ce84-5e66-445f-95a8-e8fd9688bbfd tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1347 microversion: 2.1 time: 0.108362 Sep 14 20:00:20.112092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 331/662] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:20 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:20.564592 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:20.566100 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:20.572435 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.572930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.573364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.574280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.574898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.575330 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.726109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:20.734458 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3fbe0b1d-1407-411c-a478-28dfcaf1b6ac tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1715 microversion: 2.1 time: 0.173851 Sep 14 20:00:20.735017 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 332/663] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:20 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:20.852022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:20.852268 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:20.854265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:20.867347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.867347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.867347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.867347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.868012 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.868012 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.890512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:20.893020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:20.916362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.919853 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.919853 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.920824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:20.921606 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:20.922382 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:20.979081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=8 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:21.002887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] HTTP exception thrown: Cannot 'detach_volume' instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 while it is in vm_state rescued Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Request method failure captured: Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments/55378e90-0552-41e7-a093-817588dfbc45 HTTP/1.1 Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHC0aHoqsUh3NYXw5S0NjtScfmAhqtQ_7KCs3E1xPXs3PjDdqG8hX__jCvqyY4bBMIxizbZDC30sI_OwS4Wfmd9lQT6fYu0i6zyak_x6jUWLxNCZG6MWb_mmYsjlb16N-PdYKBv5ddu76FV04I_OfIL3Ze4_gMIAwPkH5S3sWEpLdQ Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:00:21.004614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1dc64fa9e8e422fab6b3a66a29278ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}] Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 766dd5a650fc4855980250969854f08d Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:00:21.006005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Cannot 'detach_volume' instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 while it is in vm_state rescued Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'server_id': 'c75fbf44-86a1-4b99-97a3-d7e04415ac72', 'id': '55378e90-0552-41e7-a093-817588dfbc45'} Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:21.006803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 while it is in vm_state rescued Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 while it is in vm_state rescued Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:21.009084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Returning 409 to user: Cannot 'detach_volume' instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 while it is in vm_state rescued {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:21.010055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-941d6a49-0fd8-4c4e-a5bc-82c95c525c01 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments/55378e90-0552-41e7-a093-817588dfbc45" status: 409 len: 152 microversion: 2.1 time: 0.158274 Sep 14 20:00:21.010055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 332/664] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:00:20 2022] DELETE /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments/55378e90-0552-41e7-a093-817588dfbc45 => generated 152 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 20:00:21.016351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:21.017124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:21.029085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.029085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.029085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.029085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.029547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.029547 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.081189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.092461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.093789 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.094944 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cc027c40-35f7-491c-8a45-0da847da2e05 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.209368 Sep 14 20:00:21.095828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 333/665] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:20 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:21.138889 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:21.139500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:21.145421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.145860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.146611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.147722 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.148185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.148608 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.181218 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.181963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.182560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.183170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lazy-loading 'fault' on Instance uuid 254fa332-f087-4923-a1f6-2975e927cc4a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:21.239454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ebafc08399c4853959800883742eb78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fae649642b4703b649d02268bdb4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.248091 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-93185596-120f-4aad-8726-e9c5ade3f95e tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 200 len: 1347 microversion: 2.1 time: 0.113002 Sep 14 20:00:21.248823 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 334/666] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:21 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 1347 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:21.356722 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5e6f96ac-487c-4fb9-bc53-5c7e41cdf89b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "POST /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/action" status: 202 len: 0 microversion: 2.1 time: 0.344016 Sep 14 20:00:21.359976 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 333/667] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 20:00:21 2022] POST /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 20:00:21.365812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:21.366440 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:21.372447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.379359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.379846 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.380810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.381292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.381720 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.516794 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:21.532676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6a031cf7-85d3-46d9-9a2d-2c72de20c622 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1723 microversion: 2.1 time: 0.170510 Sep 14 20:00:21.538114 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 335/668] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:21 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:21.702562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:21.703392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:21.709764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.710293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.710910 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.711609 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:21.712230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:21.712659 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:21.741529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:00:22.032881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4487e743-5d43-401b-9b20-233488a7a0f8 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "DELETE /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 204 len: 0 microversion: 2.1 time: 0.334214 Sep 14 20:00:22.033587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 334/669] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:00:21 2022] DELETE /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:00:22.048635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:22.049241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:22.056492 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.056971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.057402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.058112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.058728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.059222 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.126810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:22.127628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:22.133950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.134656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.135094 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.135796 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.136252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.136698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.196169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.203933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ba680f74-e631-46f7-a443-2b63d197c201 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1514 microversion: 2.1 time: 0.159164 Sep 14 20:00:22.204500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 336/670] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:22 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:22.271580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:22.272223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] [instance: 254fa332-f087-4923-a1f6-2975e927cc4a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:22.278329 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.278826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.279281 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.279978 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.280434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.280855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.284671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.293966 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.310927 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.311072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] HTTP exception thrown: Instance 254fa332-f087-4923-a1f6-2975e927cc4a could not be found. Sep 14 20:00:22.311164 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-94dfb1e8-df7f-454f-97f4-c2c86b1fb959 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.174087 Sep 14 20:00:22.311164 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 335/671] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:22 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Request method failure captured: Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a HTTP/1.1 Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjH6GRxvMS2NfvA7vSvK7g2Oq_DMq4bEs7Z6UCUCSr3xGqhb3hIy3IK0w06q6nj9yLbmyWs6eP3MRCooy8gwRPvaTk6j-cYhBsNh7oLuEvBlOVgbjDvcrW5PWSKs6GvR-huFzEsRYfr9MDseets7KNVXkCP18l3A7wad951eFub8RFc Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 11fae649642b4703b649d02268bdb4eb Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-TestMinimumBasicScenario-736430707 Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:00:22.311304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11fae649642b4703b649d02268bdb4eb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11fae649642b4703b649d02268bdb4eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11fae649642b4703b649d02268bdb4eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11fae649642b4703b649d02268bdb4eb"}]}] Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-TestMinimumBasicScenario-736430707 Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 11fae649642b4703b649d02268bdb4eb Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-TestMinimumBasicScenario-736430707 Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-TestMinimumBasicScenario-736430707-project Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 0ebafc08399c4853959800883742eb78 Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-TestMinimumBasicScenario-736430707-project Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 254fa332-f087-4923-a1f6-2975e927cc4a could not be found. Sep 14 20:00:22.312572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '254fa332-f087-4923-a1f6-2975e927cc4a'} Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254fa332-f087-4923-a1f6-2975e927cc4a could not be found. Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:22.313291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254fa332-f087-4923-a1f6-2975e927cc4a could not be found. Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254fa332-f087-4923-a1f6-2975e927cc4a could not be found. Sep 14 20:00:22.314545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:22.315596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Returning 404 to user: Instance 254fa332-f087-4923-a1f6-2975e927cc4a could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:22.315596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3938e133-11a4-4371-9740-258160589c20 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a" status: 404 len: 111 microversion: 2.1 time: 0.032362 Sep 14 20:00:22.315596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 337/672] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:22 2022] GET /compute/v2.1/servers/254fa332-f087-4923-a1f6-2975e927cc4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 20:00:22.315788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-5aad7b52-5ec9-469c-892b-3f03fdad76e7 req-d1ee95f1-3e30-4dad-aec0-23aa681c6282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d406a90-e67e-4623-9697-11b9ed133316", "tag": "25548a24-9696-4819-a2ea-b4a68fdf3d55"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:22.315788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5aad7b52-5ec9-469c-892b-3f03fdad76e7 req-d1ee95f1-3e30-4dad-aec0-23aa681c6282 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.315788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5aad7b52-5ec9-469c-892b-3f03fdad76e7 req-d1ee95f1-3e30-4dad-aec0-23aa681c6282 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.315788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5aad7b52-5ec9-469c-892b-3f03fdad76e7 req-d1ee95f1-3e30-4dad-aec0-23aa681c6282 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.325134 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-5aad7b52-5ec9-469c-892b-3f03fdad76e7 req-d1ee95f1-3e30-4dad-aec0-23aa681c6282 service nova] Creating event network-changed:25548a24-9696-4819-a2ea-b4a68fdf3d55 for instance 2d406a90-e67e-4623-9697-11b9ed133316 on hv-cinder-83976 Sep 14 20:00:22.330124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-5aad7b52-5ec9-469c-892b-3f03fdad76e7 req-d1ee95f1-3e30-4dad-aec0-23aa681c6282 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031168 Sep 14 20:00:22.331022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 336/673] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:22.340760 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0854e0a6-ae62-4851-8f2d-b7020fd53012 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] Calling method '.version_select at 0x7f19e8ea3f70>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:22.428296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0854e0a6-ae62-4851-8f2d-b7020fd53012 tempest-TestMinimumBasicScenario-736430707 tempest-TestMinimumBasicScenario-736430707-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-727295590" status: 202 len: 0 microversion: 2.1 time: 0.091679 Sep 14 20:00:22.428926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 338/674] 10.222.0.42 () {58 vars in 1269 bytes} [Wed Sep 14 20:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-727295590 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:00:22.557893 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:22.558626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:22.564862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.565345 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.565843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.566482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:22.566935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:22.567359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:22.697758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:22.706396 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-cc8742d9-7aa6-4ba6-b0ba-691a58969a92 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1723 microversion: 2.1 time: 0.152689 Sep 14 20:00:22.706974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 337/675] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:22 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:23.227261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:23.227900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:23.234743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:23.235200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:23.235636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:23.236323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:23.236776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:23.237203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:23.327316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:23.328055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:23.334962 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:23.336255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:23.336879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:23.337855 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:23.338816 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:23.339436 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:23.372462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.380260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b60bb9a8-62f1-4d47-a682-1e21767cfa3b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1514 microversion: 2.1 time: 0.157376 Sep 14 20:00:23.389064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 339/676] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:23 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:23.470047 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.478357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.481980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.481980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-514c6670-ec13-4fb6-83e0-926627a87d8d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.157918 Sep 14 20:00:23.481980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 338/677] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:23 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:23.730142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:23.730745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:23.736763 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:23.737246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:23.737681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:23.738381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:23.740246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:23.740246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:23.879623 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:23.888699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-776bba36-0c5d-43d3-8a29-1c7269641da7 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1723 microversion: 2.1 time: 0.162423 Sep 14 20:00:23.889470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 340/678] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:23 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:24.405734 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:24.406623 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:24.414008 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:24.415127 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:24.415806 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:24.416653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:24.417222 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:24.417939 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:24.506624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:24.507240 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:24.515002 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:24.515503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:24.527855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:24.527855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:24.527855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:24.527855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:24.771701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:24.781147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:24.782716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:24.783918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5ab85df4-81b7-44a1-b2f1-298e97bbcd91 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.281346 Sep 14 20:00:24.784566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 341/679] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:24 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:24.789287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-0cec29ea-39e8-498b-90a1-5ffbfebca728 req-1d2c3df8-1377-4501-89d3-b0c634897c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207f0ea6-84c0-497d-9c93-55314ce8128a", "name": "network-vif-deleted", "tag": "a5529312-e1f4-4ca3-a519-65bc110189b5"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:24.801688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0cec29ea-39e8-498b-90a1-5ffbfebca728 req-1d2c3df8-1377-4501-89d3-b0c634897c77 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:24.802320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0cec29ea-39e8-498b-90a1-5ffbfebca728 req-1d2c3df8-1377-4501-89d3-b0c634897c77 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:24.803216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0cec29ea-39e8-498b-90a1-5ffbfebca728 req-1d2c3df8-1377-4501-89d3-b0c634897c77 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:24.817301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-0cec29ea-39e8-498b-90a1-5ffbfebca728 req-1d2c3df8-1377-4501-89d3-b0c634897c77 service nova] Creating event network-vif-deleted:a5529312-e1f4-4ca3-a519-65bc110189b5 for instance 207f0ea6-84c0-497d-9c93-55314ce8128a on hv-cinder-83976 Sep 14 20:00:24.822607 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-0cec29ea-39e8-498b-90a1-5ffbfebca728 req-1d2c3df8-1377-4501-89d3-b0c634897c77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036840 Sep 14 20:00:24.823480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 342/680] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:24.866575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:24.879164 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3ffae678-fc80-4627-ba8f-0477f45481d7 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1514 microversion: 2.1 time: 0.478157 Sep 14 20:00:24.879744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 339/681] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:24 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:24.914059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:24.914059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:24.920505 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:24.921071 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:24.921602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:24.922465 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:24.923000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:24.923500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.056707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:25.065107 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-45a1b90d-7f44-4bab-be7a-f3323d56579f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1723 microversion: 2.1 time: 0.156270 Sep 14 20:00:25.065674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 343/682] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:24 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:25.310403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:25.310926 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:25.316829 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.317321 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.317757 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.318467 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.318924 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.319357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.343411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-43fae92e-2c22-41ed-ac40-9ec69c784fa2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6/ips" status: 200 len: 150 microversion: 2.1 time: 0.036816 Sep 14 20:00:25.343985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 340/683] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 20:00:25 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:25.356682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2913a6d-452f-4f96-9c92-dbf3a567685c"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:25.359206 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:25.365219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.365699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.366166 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.366908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.367351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.367808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.447672 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Invalid volume: volume e2913a6d-452f-4f96-9c92-dbf3a567685c is already attached to instances: 1639318a-4654-444a-9f8b-34640c1cdde6 Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: POST /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6/os-volume_attachments HTTP/1.1 Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 74 Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:00:25.449470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {"volumeAttachment": {"volumeId": "e2913a6d-452f-4f96-9c92-dbf3a567685c"}} Sep 14 20:00:25.450754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Invalid volume: volume e2913a6d-452f-4f96-9c92-dbf3a567685c is already attached to instances: 1639318a-4654-444a-9f8b-34640c1cdde6 Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'server_id': 'e55857d3-b341-41f5-b675-dcb6b621d7a6', 'body': {'volumeAttachment': {'volumeId': 'e2913a6d-452f-4f96-9c92-dbf3a567685c'}}} Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e2913a6d-452f-4f96-9c92-dbf3a567685c is already attached to instances: 1639318a-4654-444a-9f8b-34640c1cdde6 Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:25.451509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e2913a6d-452f-4f96-9c92-dbf3a567685c is already attached to instances: 1639318a-4654-444a-9f8b-34640c1cdde6 Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:25.452649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e2913a6d-452f-4f96-9c92-dbf3a567685c is already attached to instances: 1639318a-4654-444a-9f8b-34640c1cdde6 Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 400 to user: Invalid volume: volume e2913a6d-452f-4f96-9c92-dbf3a567685c is already attached to instances: 1639318a-4654-444a-9f8b-34640c1cdde6 {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cf752af7-7873-4e04-be6e-9aa9c6840e47 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098359 Sep 14 20:00:25.453840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 344/684] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 20:00:25 2022] POST /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:00:25.460229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:25.460728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:25.467442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.468155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.468586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.469926 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.470391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.470821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.493113 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:25.501145 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:00:25.803270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3d975cee-a606-4c8c-8709-e0e86987fa03 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 204 len: 0 microversion: 2.1 time: 0.346642 Sep 14 20:00:25.803861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 341/685] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:00:25 2022] DELETE /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:00:25.812032 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:25.818217 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:25.822592 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.823482 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.823601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:25.823691 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.823861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:25.824271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.824830 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.825255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.830162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.830655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.831091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.831790 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.832240 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.832667 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.960757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:25.968924 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:25.970387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:25.971514 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-976d5958-ce2d-4cd6-8c64-f9b04d1e93e6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.163393 Sep 14 20:00:25.972068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 345/686] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:25 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:25.976419 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:25.977543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:25.985764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.986374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.986882 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:25.987773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:25.988219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:25.988983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:26.050656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:26.058944 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9fe5a0f6-2274-4eb5-b9c3-f42927679fe6 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1304 microversion: 2.1 time: 0.085880 Sep 14 20:00:26.059433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 346/687] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:25 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:26.076153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:26.084088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-83e7a891-944a-496f-a190-165693899e67 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1682 microversion: 2.1 time: 0.267089 Sep 14 20:00:26.084787 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 342/688] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:25 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:26.088947 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:26.089563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:26.095522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:26.096006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:26.096601 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:26.097320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:26.097776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:26.098252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:26.232784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:26.235138 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:26.242220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-04e9730f-a12f-479c-a172-acae6be5ddcd tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1723 microversion: 2.1 time: 0.157389 Sep 14 20:00:26.243075 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 347/689] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:26 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:26.996823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:26.997435 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:27.004363 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.004844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.005276 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.006026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.006478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.006896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.081881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:27.082597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:27.090568 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.091064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.091490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.092223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.092629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.093044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.128266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.128748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.129349 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.129979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lazy-loading 'fault' on Instance uuid 207f0ea6-84c0-497d-9c93-55314ce8128a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:27.154948 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:27.164210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:27.166402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:27.167535 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-98456e42-2080-4a61-abb8-146b87afed41 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.174671 Sep 14 20:00:27.168069 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 343/690] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:26 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:27.177931 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:27.178573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:27.188101 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.188697 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.189146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.190280 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.190783 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.191220 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.203820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:27.212820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-348d6476-6cbc-450b-8eda-3f131edc74ba tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1309 microversion: 2.1 time: 0.135002 Sep 14 20:00:27.213627 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 348/691] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:27 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:27.267942 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:27.268683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:27.275250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.275749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.276321 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.277026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:27.277479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:27.277926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:27.332365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:27.340756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c1dc63b1-ba43-4810-8c22-1da3809c3c5c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1682 microversion: 2.1 time: 0.171433 Sep 14 20:00:27.341329 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 344/692] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:27 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:27.489248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:27.497727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-726ef00a-967f-423b-aa62-620946969c14 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1723 microversion: 2.1 time: 0.235590 Sep 14 20:00:27.498336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 349/693] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:27 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:28.192792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:28.193407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:28.210561 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.211068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.211538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.212286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.212848 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.213228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.239623 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:28.243372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:28.262747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.263246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.263674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.268334 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.269333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.269773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.309766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.310747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.311361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.311958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lazy-loading 'fault' on Instance uuid 207f0ea6-84c0-497d-9c93-55314ce8128a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:28.415884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.419826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.425451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.428221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.428365 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-43d44765-bf3f-4792-95be-4f3158b3c12f tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1309 microversion: 2.1 time: 0.192233 Sep 14 20:00:28.428504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ea405419-f50a-424f-b67d-fc08fb59b589 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.239511 Sep 14 20:00:28.429658 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 345/694] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:28 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:28.442281 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 350/695] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:28 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:28.449726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:28.450380 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:28.456667 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.457148 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.457578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.458413 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.458883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.462595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.522190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:28.525416 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:28.531598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.532341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.532815 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.533518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.534163 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.534594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.608911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.621307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c64b36f2-0ac2-4e95-a3e5-4f1f15610219 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1682 microversion: 2.1 time: 0.189820 Sep 14 20:00:28.622233 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 346/696] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:28 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:28.701209 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:28.710123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c73dba80-21dc-47e3-b7ad-f54fe48ba0dc tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1729 microversion: 2.1 time: 0.191919 Sep 14 20:00:28.726187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 351/697] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:28 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:28.734930 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:28.735445 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:28.741427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.742018 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.742461 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.743186 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:28.743639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:28.744062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:28.863311 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0e186716-3694-43c6-8dfc-97461c05ed54 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132223 Sep 14 20:00:28.864456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 347/698] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 20:00:28 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:29.453539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:29.454367 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:29.455209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:29.456283 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:29.461775 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:29.462298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:29.462556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:29.462735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:29.463044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:29.463482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:29.463636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:29.464175 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:29.464278 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:29.464672 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:29.464807 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:29.465057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:29.496971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:29.497454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:29.497991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:29.498443 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lazy-loading 'fault' on Instance uuid 207f0ea6-84c0-497d-9c93-55314ce8128a {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:29.572555 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a66d0ec3a156469980551f9bc9034d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb2e9dd680194d6e9b861fed73188ba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:29.580840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-072a270a-54eb-4b92-b8de-1ba67b816643 tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 200 len: 1309 microversion: 2.1 time: 0.131292 Sep 14 20:00:29.581423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 352/699] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:29 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:29.646526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:29.647163 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:29.653659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:29.654161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:29.654795 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:29.655655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:29.656111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:29.656530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:30.030503 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:30.039317 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:30.041445 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:30.043073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d7ea0bb4-e60d-41a9-a9de-c45b0ada6260 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.592926 Sep 14 20:00:30.054132 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 348/700] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:29 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:30.149979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:30.161201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fce582fc-5c0b-4e79-81e4-9fd83854e97d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1682 microversion: 2.1 time: 0.518455 Sep 14 20:00:30.161952 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 353/701] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:29 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1682 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:30.280191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-36f4bc0b-8362-4dbb-ac35-e44e1b3149e3 req-4ada4681-d3b1-4700-b74d-b72981d52d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75fbf44-86a1-4b99-97a3-d7e04415ac72", "tag": "ae006861-47e1-449b-b3aa-d229e77ec13d"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:30.301896 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-36f4bc0b-8362-4dbb-ac35-e44e1b3149e3 req-4ada4681-d3b1-4700-b74d-b72981d52d98 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:30.302377 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-36f4bc0b-8362-4dbb-ac35-e44e1b3149e3 req-4ada4681-d3b1-4700-b74d-b72981d52d98 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:30.302799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-36f4bc0b-8362-4dbb-ac35-e44e1b3149e3 req-4ada4681-d3b1-4700-b74d-b72981d52d98 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:30.322991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-36f4bc0b-8362-4dbb-ac35-e44e1b3149e3 req-4ada4681-d3b1-4700-b74d-b72981d52d98 service nova] Creating event network-changed:ae006861-47e1-449b-b3aa-d229e77ec13d for instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 on hv-cinder-83976 Sep 14 20:00:30.329605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-36f4bc0b-8362-4dbb-ac35-e44e1b3149e3 req-4ada4681-d3b1-4700-b74d-b72981d52d98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057476 Sep 14 20:00:30.333183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 349/702] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:30.606015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:30.607212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] [instance: 207f0ea6-84c0-497d-9c93-55314ce8128a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:30.615504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:30.616210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:30.616827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:30.617720 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:30.618472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:30.619598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:30.639534 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] HTTP exception thrown: Instance 207f0ea6-84c0-497d-9c93-55314ce8128a could not be found. Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Request method failure captured: Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a HTTP/1.1 Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjI-GCwEqvYX7VKXLYESFQtkjULMXWodHp3JeoUN5b6Gp6DQk22--hZ_tOzEPELb3BzbUxFHe53FTZX1TtyIGDfJhYT-5O8AGTzZ6m03lEEE2xEWb-wmVqk6OLyiyOPPSTnyW3c9dYMGbnIGTz9E0kDbfTPBQaguFE0ZQW-si-isPA4 Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: bb2e9dd680194d6e9b861fed73188ba6 Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-VolumesSnapshotTestJSON-204134938 Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:00:30.641447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb2e9dd680194d6e9b861fed73188ba6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb2e9dd680194d6e9b861fed73188ba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb2e9dd680194d6e9b861fed73188ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb2e9dd680194d6e9b861fed73188ba6"}]}] Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-VolumesSnapshotTestJSON-204134938 Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: bb2e9dd680194d6e9b861fed73188ba6 Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-204134938 Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-VolumesSnapshotTestJSON-204134938-project Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: a66d0ec3a156469980551f9bc9034d4e Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-VolumesSnapshotTestJSON-204134938-project Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 207f0ea6-84c0-497d-9c93-55314ce8128a could not be found. Sep 14 20:00:30.643028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '207f0ea6-84c0-497d-9c93-55314ce8128a'} Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207f0ea6-84c0-497d-9c93-55314ce8128a could not be found. Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:30.643894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207f0ea6-84c0-497d-9c93-55314ce8128a could not be found. Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207f0ea6-84c0-497d-9c93-55314ce8128a could not be found. Sep 14 20:00:30.645351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:30.647501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] Returning 404 to user: Instance 207f0ea6-84c0-497d-9c93-55314ce8128a could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:30.648627 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f1d72584-8bc7-42c4-9138-3f66fd5aa39b tempest-VolumesSnapshotTestJSON-204134938 tempest-VolumesSnapshotTestJSON-204134938-project] 10.222.0.42 "GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a" status: 404 len: 111 microversion: 2.1 time: 0.047880 Sep 14 20:00:30.653534 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 354/703] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:30 2022] GET /compute/v2.1/servers/207f0ea6-84c0-497d-9c93-55314ce8128a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:00:30.893225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-95f2a68f-a532-4de1-8e11-bf3f58004d73 req-963a541f-d00b-4be4-bcb6-83034649ca8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55857d3-b341-41f5-b675-dcb6b621d7a6", "name": "network-vif-deleted", "tag": "f197bca5-7df1-4f79-9a38-365a80094434"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:30.927758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-95f2a68f-a532-4de1-8e11-bf3f58004d73 req-963a541f-d00b-4be4-bcb6-83034649ca8a service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:30.928753 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-95f2a68f-a532-4de1-8e11-bf3f58004d73 req-963a541f-d00b-4be4-bcb6-83034649ca8a service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:30.931488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-95f2a68f-a532-4de1-8e11-bf3f58004d73 req-963a541f-d00b-4be4-bcb6-83034649ca8a service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:30.970373 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-95f2a68f-a532-4de1-8e11-bf3f58004d73 req-963a541f-d00b-4be4-bcb6-83034649ca8a service nova] Creating event network-vif-deleted:f197bca5-7df1-4f79-9a38-365a80094434 for instance e55857d3-b341-41f5-b675-dcb6b621d7a6 on hv-cinder-83976 Sep 14 20:00:30.987514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-95f2a68f-a532-4de1-8e11-bf3f58004d73 req-963a541f-d00b-4be4-bcb6-83034649ca8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098311 Sep 14 20:00:30.990960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 350/704] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:31.077542 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:31.079311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:31.094307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:31.095139 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:31.095646 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:31.099671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:31.100243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:31.100900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:31.191473 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:31.193136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:31.213665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:31.224046 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:31.226370 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:31.227705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:31.228233 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:31.228658 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:31.321474 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:31.322114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:31.322832 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:31.326501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid e55857d3-b341-41f5-b675-dcb6b621d7a6 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:31.381787 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:31.393494 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:31.396157 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:31.396641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-780f32d1-41ef-4afb-94c5-b46b9140c51a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.330953 Sep 14 20:00:31.397728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 355/705] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:31 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:31.405297 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:31.428059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fc0579c0-a6c0-4456-879d-b59cca1dd3f6 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 200 len: 1331 microversion: 2.1 time: 0.243363 Sep 14 20:00:31.431126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 351/706] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:31 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 1331 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:32.351581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-71fb71b4-631d-4ec2-aeef-58032fa1c36d req-c3806671-8e50-4bf6-8519-e454b667047e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75fbf44-86a1-4b99-97a3-d7e04415ac72", "tag": "ae006861-47e1-449b-b3aa-d229e77ec13d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:32.362677 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-71fb71b4-631d-4ec2-aeef-58032fa1c36d req-c3806671-8e50-4bf6-8519-e454b667047e service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:32.363363 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-71fb71b4-631d-4ec2-aeef-58032fa1c36d req-c3806671-8e50-4bf6-8519-e454b667047e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:32.363991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-71fb71b4-631d-4ec2-aeef-58032fa1c36d req-c3806671-8e50-4bf6-8519-e454b667047e service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:32.377499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-71fb71b4-631d-4ec2-aeef-58032fa1c36d req-c3806671-8e50-4bf6-8519-e454b667047e service nova] Creating event network-changed:ae006861-47e1-449b-b3aa-d229e77ec13d for instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 on hv-cinder-83976 Sep 14 20:00:32.383858 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-71fb71b4-631d-4ec2-aeef-58032fa1c36d req-c3806671-8e50-4bf6-8519-e454b667047e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035298 Sep 14 20:00:32.389228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 356/707] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:32.434490 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:32.438049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:32.456879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:32.457046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:32.457676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:32.462653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:32.463112 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:32.463861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:32.464407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:32.472563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:32.472805 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:32.473643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:32.474315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:32.475285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:32.475930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:32.476836 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:32.502640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 HTTP/1.1 Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:00:32.511143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:00:32.513154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'e55857d3-b341-41f5-b675-dcb6b621d7a6'} Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:32.514142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:00:32.515619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:00:32.517177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:32.517177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ac6f70e9-ae71-4c9b-9ed4-571ff95a5915 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 404 len: 111 microversion: 2.1 time: 0.060361 Sep 14 20:00:32.517177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 357/708] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:32 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:00:32.532029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d5963a57-76f4-4a58-adf6-a869c81786f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '.version_select at 0x7f19e8f53670>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:32.685192 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d5963a57-76f4-4a58-adf6-a869c81786f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299282960" status: 202 len: 0 microversion: 2.1 time: 0.168420 Sep 14 20:00:32.685774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 358/709] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 20:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299282960 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:00:32.785251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:32.813120 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:32.816727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:32.820447 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-cb482e1c-6ee6-4c65-958b-3464a2f71259 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.394487 Sep 14 20:00:32.824114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 352/710] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:32 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:33.860982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:33.863863 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:33.879956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:33.881150 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:33.882474 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:33.884031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:33.884770 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:33.885451 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:33.928146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-04ed0c77-9dd0-4efa-874a-a89528430232 req-fdccd318-2255-47b7-b8d6-9a4571c8105d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d406a90-e67e-4623-9697-11b9ed133316", "name": "network-vif-plugged", "status": "completed", "tag": "25548a24-9696-4819-a2ea-b4a68fdf3d55"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:33.940501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-04ed0c77-9dd0-4efa-874a-a89528430232 req-fdccd318-2255-47b7-b8d6-9a4571c8105d service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:33.942200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-04ed0c77-9dd0-4efa-874a-a89528430232 req-fdccd318-2255-47b7-b8d6-9a4571c8105d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:33.942892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-04ed0c77-9dd0-4efa-874a-a89528430232 req-fdccd318-2255-47b7-b8d6-9a4571c8105d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:33.958947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-04ed0c77-9dd0-4efa-874a-a89528430232 req-fdccd318-2255-47b7-b8d6-9a4571c8105d service nova] Creating event network-vif-plugged:25548a24-9696-4819-a2ea-b4a68fdf3d55 for instance 2d406a90-e67e-4623-9697-11b9ed133316 on hv-cinder-83976 Sep 14 20:00:33.966783 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-04ed0c77-9dd0-4efa-874a-a89528430232 req-fdccd318-2255-47b7-b8d6-9a4571c8105d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042643 Sep 14 20:00:33.968489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 353/711] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:33.975962 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:33.976789 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:33.985638 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:33.986388 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:33.987056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:33.988631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:33.989432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:33.990187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:34.048448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:34.057233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:34.059557 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:34.060975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e9582acc-80a1-40bf-aecf-f7fd9795d942 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.214226 Sep 14 20:00:34.062041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 359/712] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:33 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:34.105599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'services' on Instance uuid 1639318a-4654-444a-9f8b-34640c1cdde6 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:34.380487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4d38a301-3a62-4c16-8e81-21ddcec883ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments/e2913a6d-452f-4f96-9c92-dbf3a567685c" status: 202 len: 0 microversion: 2.1 time: 0.409842 Sep 14 20:00:34.381076 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 354/713] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:00:33 2022] DELETE /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments/e2913a6d-452f-4f96-9c92-dbf3a567685c => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:00:34.390097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:34.394110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:34.399893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:34.400379 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:34.400813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:34.401940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:34.402504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:34.402929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:34.436105 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-11e76d6d-8b84-455e-8183-665326eda725 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049974 Sep 14 20:00:34.436658 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 360/714] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:34 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:35.087439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:35.088159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:35.094423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:35.094920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:35.095360 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:35.096087 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:35.096519 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:35.096943 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:35.389051 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:35.397241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:35.398750 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:35.400413 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d6a44e0a-795d-45f4-a047-8852dfb5bc70 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.317693 Sep 14 20:00:35.400953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 355/715] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:35 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:35.448543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:35.450717 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:35.457651 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:35.458195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:35.458634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:35.459351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:35.459812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:35.460256 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:35.490434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4cebae80-4986-4c0b-a8fc-b0249da888de tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Sep 14 20:00:35.490990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 361/716] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:35 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:36.430857 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:36.431576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:36.438442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:36.438935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:36.439370 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:36.440061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:36.440517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:36.440945 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:36.502752 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:36.505136 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:36.513044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:36.513734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:36.514302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:36.515103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:36.515804 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:36.516292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:36.546728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bc9a5abe-e151-4939-b224-ae2ce315ef52 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047997 Sep 14 20:00:36.547729 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 362/717] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:36 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:00:36.574760 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:36.583081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:36.584755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:36.585904 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f9553b51-3207-4585-9e9f-49a4c5c0ae5e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.159528 Sep 14 20:00:36.586452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 356/718] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:36 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:37.559827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:37.562247 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:37.570061 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:37.570550 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:37.571537 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:37.572282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:37.572715 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:37.573246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:37.603602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4d4a8df2-f2c3-4b54-9231-ce33b4424f07 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048377 Sep 14 20:00:37.604157 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 363/719] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:37 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:37.613689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:37.619230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:37.619230 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:37.622441 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:37.622931 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:37.623471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:37.624177 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:37.624630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:37.625055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:37.775081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:37.778439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:37.783338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:37.784775 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:37.785897 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b323fab3-72cd-40b1-93ab-b64fd3af67c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1407 microversion: 2.20 time: 0.176342 Sep 14 20:00:37.786447 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 357/720] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:37 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:00:38.616290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:38.618506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:38.625051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:38.625754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:38.626216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:38.626909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:38.627449 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:38.627879 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:38.658845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8c89cb14-5fb1-42f5-990b-730222a00a4d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046681 Sep 14 20:00:38.659647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 364/721] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:00:38 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 20:00:38.732704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:38.733430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:38.742291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:38.747049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:38.747049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:38.747049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:38.747049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:38.747477 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:38.775997 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:00:38.812271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:38.813158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:38.826436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:38.826931 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:38.827372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:38.828099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:38.828551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:38.828973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:39.100841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:39.108551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:39.110021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:39.111386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1cd24040-a80b-4856-886a-4c8dc33550e4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1600 microversion: 2.20 time: 0.303431 Sep 14 20:00:39.111942 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 365/722] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:00:38 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1600 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:00:39.141021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:39.141021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:39.146369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:39.147004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:39.147446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:39.149829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:39.149829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:39.149829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:39.165910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:39.228772 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6d4311f0-ba03-47d2-832d-925bd93d8d50 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 204 len: 0 microversion: 2.1 time: 0.495126 Sep 14 20:00:39.228772 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 358/723] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:00:38 2022] DELETE /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:00:39.239115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:39.239960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:39.242405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-964f5b13-fb2a-43fc-87ad-fd250c3e6621 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107751 Sep 14 20:00:39.243521 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 366/724] 10.222.0.42 () {60 vars in 1316 bytes} [Wed Sep 14 20:00:39 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 20:00:39.256672 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:39.257259 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:39.257722 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:39.259338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:39.259804 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:39.260316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:39.586111 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:39.594969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a6b76916-56fb-40e5-8252-21260870a741 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1680 microversion: 2.1 time: 0.363079 Sep 14 20:00:39.611864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 359/725] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:39 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1680 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:00:40.620827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:40.622097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:40.628963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:40.629949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:40.630632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:40.636343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:40.636343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:40.636343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:40.791859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:40.830181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-44ed2807-16a9-450d-af9f-6850c47c7b10 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1680 microversion: 2.1 time: 0.214557 Sep 14 20:00:40.831269 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 367/726] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:40 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:41.168559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-1e19ac29-c808-4c13-b167-0cedaf7e2ae0 req-3ae98788-f8d5-4cfb-b56d-391d9672902a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d406a90-e67e-4623-9697-11b9ed133316", "tag": "25548a24-9696-4819-a2ea-b4a68fdf3d55"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:41.183341 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1e19ac29-c808-4c13-b167-0cedaf7e2ae0 req-3ae98788-f8d5-4cfb-b56d-391d9672902a service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:41.184800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1e19ac29-c808-4c13-b167-0cedaf7e2ae0 req-3ae98788-f8d5-4cfb-b56d-391d9672902a service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:41.184800 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1e19ac29-c808-4c13-b167-0cedaf7e2ae0 req-3ae98788-f8d5-4cfb-b56d-391d9672902a service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:41.199716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-1e19ac29-c808-4c13-b167-0cedaf7e2ae0 req-3ae98788-f8d5-4cfb-b56d-391d9672902a service nova] Creating event network-changed:25548a24-9696-4819-a2ea-b4a68fdf3d55 for instance 2d406a90-e67e-4623-9697-11b9ed133316 on hv-cinder-83976 Sep 14 20:00:41.205202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-1e19ac29-c808-4c13-b167-0cedaf7e2ae0 req-3ae98788-f8d5-4cfb-b56d-391d9672902a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046872 Sep 14 20:00:41.208627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 360/727] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:41.856075 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:41.857337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:41.865530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:41.872915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:41.872915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:41.872915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:41.872915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:41.873252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:41.971393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:41.988191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8f2697b0-3754-461c-890e-8d3042f493ce tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1612 microversion: 2.1 time: 0.134769 Sep 14 20:00:42.002156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 368/728] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:41 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1612 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:42.359561 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-3fe607cc-0078-4f2f-aac1-63c635a66361 req-da1552d5-55fc-4069-b2b1-54f3747f2679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1639318a-4654-444a-9f8b-34640c1cdde6", "name": "network-vif-deleted", "tag": "cdd586f3-f977-486d-b725-4d00c58613e2"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:42.376991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3fe607cc-0078-4f2f-aac1-63c635a66361 req-da1552d5-55fc-4069-b2b1-54f3747f2679 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:42.377555 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3fe607cc-0078-4f2f-aac1-63c635a66361 req-da1552d5-55fc-4069-b2b1-54f3747f2679 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:42.378246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3fe607cc-0078-4f2f-aac1-63c635a66361 req-da1552d5-55fc-4069-b2b1-54f3747f2679 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:42.391218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-3fe607cc-0078-4f2f-aac1-63c635a66361 req-da1552d5-55fc-4069-b2b1-54f3747f2679 service nova] Creating event network-vif-deleted:cdd586f3-f977-486d-b725-4d00c58613e2 for instance 1639318a-4654-444a-9f8b-34640c1cdde6 on hv-cinder-83976 Sep 14 20:00:42.396784 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-3fe607cc-0078-4f2f-aac1-63c635a66361 req-da1552d5-55fc-4069-b2b1-54f3747f2679 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041717 Sep 14 20:00:42.397632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 361/729] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:43.020350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:43.021533 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:43.047989 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:43.049072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:43.050033 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:43.050982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:43.052285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:43.058245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:43.100480 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:43.101167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:43.101663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:43.102840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 1639318a-4654-444a-9f8b-34640c1cdde6 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:43.148877 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:43.157391 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c5a11617-0669-40bb-b9a9-c8a3dcd6376e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1331 microversion: 2.1 time: 0.141364 Sep 14 20:00:43.167574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 369/730] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:43 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:44.183212 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:44.183922 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:44.199412 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:44.199909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:44.200351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:44.206909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:44.207403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:44.207847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:44.274332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:44.274802 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:44.275236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:44.275687 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 1639318a-4654-444a-9f8b-34640c1cdde6 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:44.377952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:44.386305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d6bf9081-f828-4fff-9271-71f41be9fd05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1331 microversion: 2.1 time: 0.208433 Sep 14 20:00:44.386880 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 362/731] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:44 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1331 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:45.409072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:45.409681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:45.416624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:45.417103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:45.417538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:45.418266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:45.418721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:45.419145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:45.455359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:45.456189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:45.456624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:45.457063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 1639318a-4654-444a-9f8b-34640c1cdde6 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:00:45.521912 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:45.531212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9891c0d7-7af0-441d-b28f-b3d1c603d28f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 200 len: 1331 microversion: 2.1 time: 0.125962 Sep 14 20:00:45.532058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 370/732] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:45 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:46.559308 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:46.560503 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:46.567693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:46.568522 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:46.569265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:46.569989 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:46.570443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:46.571401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:46.586863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 HTTP/1.1 Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:00:46.589026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:00:46.590599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '1639318a-4654-444a-9f8b-34640c1cdde6'} Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:00:46.591367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:00:46.592842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:00:46.594979 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:00:46.596003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-11eb83e9-d830-4566-b95c-b4cba5b46d17 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 404 len: 111 microversion: 2.1 time: 0.041867 Sep 14 20:00:46.600299 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 363/733] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:46 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:00:46.605394 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6e76ad4a-353c-4ceb-8cfe-38d09ebe9d1e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '.version_select at 0x7f19e5758a60>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:46.611990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:00:46.685529 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6e76ad4a-353c-4ceb-8cfe-38d09ebe9d1e tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598543709" status: 202 len: 0 microversion: 2.1 time: 0.084231 Sep 14 20:00:46.686604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 371/734] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Sep 14 20:00:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598543709 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 20:00:47.870399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-abe760ff-bd40-489a-8a85-b6fd77b17fde tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: .version_select at 0x7f19e5580940>, body: {"keypair": {"name": "tempest-keypair-357598214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8o9PrapYSXz8+uH5AR1hXDbdJEvEf0PJhJQGlDzd+N69ZB3fZ0zlLQ0rww+jyQSZd3hgQ0QIbzTs0TsuzPHjQAK9Hp2WUa1cS3QR7NCPqSdrlyiYmJNZfrRDzP6kJQRA=="}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:47.890635 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-abe760ff-bd40-489a-8a85-b6fd77b17fde tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:00:47.905618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-abe760ff-bd40-489a-8a85-b6fd77b17fde tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:00:48.034587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-abe760ff-bd40-489a-8a85-b6fd77b17fde tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170055 Sep 14 20:00:48.035193 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 364/735] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 20:00:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:51.789298 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-917032841", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdcbc0df-73f5-4094-bf95-288827ed92e6"}], "security_groups": [{"name": "tempest-securitygroup--1938638502"}], "key_name": "tempest-keypair-357598214", "user_data": "}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:51.890814 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-404001e9-af5a-44da-9f6b-2a8af316b977 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Action: 'create', calling method: .version_select at 0x7f19e8e67f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1022979039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfzzd2Fhe0C/dR6JGT84qQ5sbtK4k5leB2RWmp/CilM/0KZxayTBiTAhXlxK7vaN2coZeskHUglLAkG5fyZUBDSqpeiowZQ/FAdH/vshBcOPV2HV7JQzscmhqOwUKgdow=="}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:51.903897 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] validate_networks() for [('fdcbc0df-73f5-4094-bf95-288827ed92e6', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:00:51.906455 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-404001e9-af5a-44da-9f6b-2a8af316b977 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Getting quotas for project 2d5c2273800e43a096bce8807c31fbf5. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:00:51.910340 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-404001e9-af5a-44da-9f6b-2a8af316b977 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Getting quotas for user 04af0db8835d427092c076d35b3e67d9 and project 2d5c2273800e43a096bce8807c31fbf5. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:00:51.988774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-404001e9-af5a-44da-9f6b-2a8af316b977 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.278635 Sep 14 20:00:51.989829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 372/736] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 20:00:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:52.399683 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:00:52.400143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:00:52.400625 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:00:52.401040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:00:52.401457 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:00:52.410519 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:52.410996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:52.411430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:52.412147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:52.412596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:52.413062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:52.434996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:00:52.440702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:00:52.456332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:00:52.458685 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:00:52.635852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5cf96745-2f4b-4f0c-b1fc-7fe388d73fe0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.851742 Sep 14 20:00:52.636645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 365/737] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:00:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 20:00:52.648580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-30b0ea2b-dfec-4d64-ab98-8b906dfd5522 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:52.649764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-30b0ea2b-dfec-4d64-ab98-8b906dfd5522 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:52.734376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-30b0ea2b-dfec-4d64-ab98-8b906dfd5522 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:52.745981 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-30b0ea2b-dfec-4d64-ab98-8b906dfd5522 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1240 microversion: 2.1 time: 0.101561 Sep 14 20:00:52.761828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 373/738] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:52 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1240 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:53.776288 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:53.776288 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:53.779512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:53.780233 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:53.780912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:53.781911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:53.782441 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:53.783026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:53.850217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:53.859200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-dee6600e-daa6-46b3-aa98-c141ed30b062 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1244 microversion: 2.1 time: 0.091347 Sep 14 20:00:53.859886 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 366/739] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:53 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:54.884496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:54.885558 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:54.894160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:54.895210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:54.896056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:54.896990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:54.897605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:54.898466 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:55.003327 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:55.030824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5432ba61-c132-4f7d-864c-8fe837521831 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1292 microversion: 2.1 time: 0.150473 Sep 14 20:00:55.031565 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 374/740] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:54 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1292 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:56.056568 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:56.057226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:56.064489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:56.064977 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:56.065410 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:56.066140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:56.066595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:56.067024 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:56.214011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:56.223015 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-48e21008-ecc8-48f2-9dbd-d59b37b49c18 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.171306 Sep 14 20:00:56.227581 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 367/741] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:56 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:57.158622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-c0a173c1-3d89-42fa-82dd-b461698b1b9d req-ded70bf4-8d2d-476d-b2bf-62cbd551dcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e", "tag": "418e2560-6dba-4405-b1ca-657319b5665c"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:00:57.169999 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c0a173c1-3d89-42fa-82dd-b461698b1b9d req-ded70bf4-8d2d-476d-b2bf-62cbd551dcb8 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:57.170479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c0a173c1-3d89-42fa-82dd-b461698b1b9d req-ded70bf4-8d2d-476d-b2bf-62cbd551dcb8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:57.170903 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c0a173c1-3d89-42fa-82dd-b461698b1b9d req-ded70bf4-8d2d-476d-b2bf-62cbd551dcb8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:57.182968 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-c0a173c1-3d89-42fa-82dd-b461698b1b9d req-ded70bf4-8d2d-476d-b2bf-62cbd551dcb8 service nova] Creating event network-changed:418e2560-6dba-4405-b1ca-657319b5665c for instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e on hv-cinder-83976 Sep 14 20:00:57.189661 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-c0a173c1-3d89-42fa-82dd-b461698b1b9d req-ded70bf4-8d2d-476d-b2bf-62cbd551dcb8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036819 Sep 14 20:00:57.191562 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 375/742] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:00:57.257509 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:57.258158 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:57.264972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:57.265464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:57.265908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:57.266620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:57.267058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:57.267491 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:57.409986 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:57.419426 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b9d1c80a-a934-41d2-96c9-9b3f0f9ba0f4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.166730 Sep 14 20:00:57.420157 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 368/743] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:57 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:58.448635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:58.449319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:58.457307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:58.457793 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:58.458371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:58.459055 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:58.459703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:58.460213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:58.599161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:58.607863 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a70e864f-38ac-4ed6-9e39-667bfae081a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.164065 Sep 14 20:00:58.608446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 376/744] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:58 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:00:59.632072 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:00:59.632769 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:00:59.640577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:59.641165 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:59.641665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:59.642445 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:00:59.642965 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:00:59.643456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:00:59.778263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:00:59.786186 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-aaad1b6e-dfd8-44f0-95af-16f81a66107d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.158710 Sep 14 20:00:59.786745 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 369/745] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:00:59 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:00.406612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:00.409029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:00.415718 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.416207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.416642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.417339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.417840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.418271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.448167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ab60aaca-3a6f-4be5-affe-03a20c100147 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046246 Sep 14 20:01:00.448765 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 377/746] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:01:00 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 20:01:00.514993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:00.514993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:00.519182 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.519668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.520316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.521009 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.521654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.522120 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.548970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:01:00.816655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:00.816655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:00.821679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.822297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.822803 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.823560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.824119 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.824540 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.908516 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-09ff3f86-1ab0-47cb-9f38-5277ecd8fa8d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 204 len: 0 microversion: 2.1 time: 0.400208 Sep 14 20:01:00.910073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 370/747] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:01:00 2022] DELETE /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:01:00.923563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:00.924540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:00.931367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.931883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.932325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.933049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:00.933528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:00.933976 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:00.972028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:00.979696 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1f166d3e-8e98-46b5-9641-da5d9e60afe5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.172622 Sep 14 20:01:00.980298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 378/748] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:00 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:01.089423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:01.099589 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d3351484-067b-465f-9463-c5ec9a3d1bc0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1673 microversion: 2.1 time: 0.180696 Sep 14 20:01:01.100522 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 371/749] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:00 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:02.010348 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:02.010958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:02.017013 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:02.017498 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:02.017963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:02.018647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:02.019096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:02.021269 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:02.123951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:02.124590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:02.131477 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:02.131911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:02.132352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:02.133751 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:02.134243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:02.134676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:02.159338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:02.167303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e729a59d-860b-4d88-9fa9-6e3bf3bf08bf tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.161950 Sep 14 20:01:02.168056 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 379/750] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:02 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:02.283312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:02.291279 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fce9aeb5-e3d6-46f1-81a8-3f0d8c081403 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1673 microversion: 2.1 time: 0.171320 Sep 14 20:01:02.291892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 372/751] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:02 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:02.760308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-15079673-ba77-4950-9d98-17c08f318452 req-9ab0de50-ae27-4947-93e5-d5204e4f03a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e", "name": "network-vif-plugged", "status": "completed", "tag": "418e2560-6dba-4405-b1ca-657319b5665c"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:02.766257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=6 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:02.771932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-15079673-ba77-4950-9d98-17c08f318452 req-9ab0de50-ae27-4947-93e5-d5204e4f03a8 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:02.772435 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-15079673-ba77-4950-9d98-17c08f318452 req-9ab0de50-ae27-4947-93e5-d5204e4f03a8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:02.772856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-15079673-ba77-4950-9d98-17c08f318452 req-9ab0de50-ae27-4947-93e5-d5204e4f03a8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:02.783801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-15079673-ba77-4950-9d98-17c08f318452 req-9ab0de50-ae27-4947-93e5-d5204e4f03a8 service nova] Creating event network-vif-plugged:418e2560-6dba-4405-b1ca-657319b5665c for instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e on hv-cinder-83976 Sep 14 20:01:02.788917 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-15079673-ba77-4950-9d98-17c08f318452 req-9ab0de50-ae27-4947-93e5-d5204e4f03a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Sep 14 20:01:02.789980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 380/752] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:03.194695 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:03.196114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:03.200872 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:03.201566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=10 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:03.205890 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:03.206632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:03.207337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:03.208218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:03.209007 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:03.209428 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:03.316517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:03.317908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:03.339307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:03.340185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:03.340812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:03.341719 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:03.342412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:03.342840 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:03.427925 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:03.448941 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6c2b41d6-7155-45a6-ae4d-89f221935cf9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.257036 Sep 14 20:01:03.448941 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 373/753] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:03 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:03.603124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:03.611209 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c77994b9-8d04-4fb9-9d28-7fed358312ea tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1673 microversion: 2.1 time: 0.299800 Sep 14 20:01:03.611819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 381/754] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:03 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1673 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:04.363443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-fe89f718-478b-464e-871a-4f6e68b246f0 req-23de1ba4-db42-4a5e-8d2d-950e74f64de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70804c4-376b-4606-bd6f-4414c9892629", "name": "network-vif-deleted", "tag": "d1e43dde-90ba-4d12-83de-29affbae5075"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:04.376147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-fe89f718-478b-464e-871a-4f6e68b246f0 req-23de1ba4-db42-4a5e-8d2d-950e74f64de4 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:04.376631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-fe89f718-478b-464e-871a-4f6e68b246f0 req-23de1ba4-db42-4a5e-8d2d-950e74f64de4 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:04.377216 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-fe89f718-478b-464e-871a-4f6e68b246f0 req-23de1ba4-db42-4a5e-8d2d-950e74f64de4 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:04.389231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-fe89f718-478b-464e-871a-4f6e68b246f0 req-23de1ba4-db42-4a5e-8d2d-950e74f64de4 service nova] Creating event network-vif-deleted:d1e43dde-90ba-4d12-83de-29affbae5075 for instance f70804c4-376b-4606-bd6f-4414c9892629 on hv-cinder-83976 Sep 14 20:01:04.394602 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-fe89f718-478b-464e-871a-4f6e68b246f0 req-23de1ba4-db42-4a5e-8d2d-950e74f64de4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194023 Sep 14 20:01:04.395437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 374/755] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:04.472814 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:04.473439 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:04.481011 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:04.481508 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:04.481977 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:04.482683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:04.483161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:04.483591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:04.625344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:04.635600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a7b1976d-e5d7-43f5-9243-d9e02a454642 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.166801 Sep 14 20:01:04.636651 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 382/756] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:04 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:04.642297 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:04.642297 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:04.644773 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:04.645439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:04.646074 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:04.646823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:04.647270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:04.647696 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:04.652741 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:04.721316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:04.730855 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c5bc8dcf-f054-499a-b3c2-86083e5cd187 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1321 microversion: 2.1 time: 0.099759 Sep 14 20:01:04.731438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 375/757] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:04 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1321 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:05.661113 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:05.661952 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:05.669217 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:05.669697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:05.670160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:05.670850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:05.671300 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:05.671718 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:05.753269 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:05.753904 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:05.760628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:05.761111 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:05.761552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:05.762267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:05.762717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:05.763136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:05.809154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:05.816793 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-32f901fc-53ea-4f94-85cb-1aa77580a390 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.160825 Sep 14 20:01:05.817364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 383/758] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:05 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:05.827744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:05.836758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-616bfc0a-2502-4ae3-8b54-852d5e3b94e8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1321 microversion: 2.1 time: 0.087546 Sep 14 20:01:05.838526 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 376/759] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:05 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1321 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:06.839599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:06.840206 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:06.846728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:06.847219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:06.847655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:06.848350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:06.848797 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:06.849214 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:06.860149 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:06.860759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:06.866714 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:06.867196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:06.867633 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:06.868322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:06.869270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:06.869702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:06.936202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:06.941828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-88c44f2f-ba99-4d28-bcfe-13c1a94aa17f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1321 microversion: 2.1 time: 0.086046 Sep 14 20:01:06.942407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 377/760] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:06 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1321 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:06.983529 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:06.991060 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4d3a0f0c-6a58-414e-9176-3796270e3fef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.155410 Sep 14 20:01:06.991617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 384/761] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:06 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:07.968734 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:07.968734 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:07.974392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:07.974794 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:07.975419 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:07.976247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:07.976737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:07.977171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.012688 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:08.013540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:08.014140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.014659 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'fault' on Instance uuid f70804c4-376b-4606-bd6f-4414c9892629 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:08.015023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:08.015707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:08.023553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:08.024070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:08.025727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.026703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:08.027263 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:08.027764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.069542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:08.079785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3c27ebe7-045c-4cf8-a5e0-2722f26e0ed3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1326 microversion: 2.1 time: 0.119044 Sep 14 20:01:08.087413 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 378/762] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:07 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1326 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:08.148578 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:08.152058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:08.160246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:08.160736 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:08.161174 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.161951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:08.162573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:08.163394 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.182153 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:08.191798 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6a93ee93-c938-4920-a953-d6ea62f36111 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1366 microversion: 2.1 time: 0.182070 Sep 14 20:01:08.192523 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 385/763] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:08 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:08.254621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'services' on Instance uuid c75fbf44-86a1-4b99-97a3-d7e04415ac72 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:08.466109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3fb7c26f-a728-452e-bece-cb5f3fd15a68 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments/55378e90-0552-41e7-a093-817588dfbc45" status: 202 len: 0 microversion: 2.1 time: 0.321259 Sep 14 20:01:08.466697 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 379/764] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:01:08 2022] DELETE /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments/55378e90-0552-41e7-a093-817588dfbc45 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 20:01:08.475085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:08.477333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:08.483570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:08.484296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:08.484483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.485172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:08.485617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:08.486065 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:08.517747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bd891afe-21ac-41d3-a10e-58ed39d0217e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046475 Sep 14 20:01:08.518444 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 386/765] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:01:08 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:09.105678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:09.106334 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:09.108376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:09.113270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.113757 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.114225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.114916 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.115372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.115801 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.145470 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.146110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.146552 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.146998 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'fault' on Instance uuid f70804c4-376b-4606-bd6f-4414c9892629 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:09.188651 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:09.197011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-062306a8-6281-402a-8b33-7b8e209bb321 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1326 microversion: 2.1 time: 0.097040 Sep 14 20:01:09.197598 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 380/766] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:09 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:09.216411 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:09.217051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:09.223476 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.223954 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.224391 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.225077 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.225530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.225997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.230627 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:09.353821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:09.361665 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-08ece40f-3106-4ab7-8b42-8a460ec4601b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1556 microversion: 2.1 time: 0.149545 Sep 14 20:01:09.362198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 387/767] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:09 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:09.384095 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:09.384594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:09.391639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.392122 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.392560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.393247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.393706 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.394162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.470620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-098eec8e-d5c1-47da-9a13-1e65323fe5b4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090658 Sep 14 20:01:09.471231 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 381/768] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 20:01:09 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:09.530963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:09.533088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:09.538861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.539342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.539771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.540500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:09.540950 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:09.541371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:09.569831 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2f4b58c7-d980-48bf-a069-e43609ebbe1d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 Sep 14 20:01:09.570540 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 388/769] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:01:09 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:10.220735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:10.221348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:10.227357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:10.227846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:10.228287 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:10.229489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:10.229980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:10.230455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:10.263712 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:10.264199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:10.264644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:10.265090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'fault' on Instance uuid f70804c4-376b-4606-bd6f-4414c9892629 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:10.312107 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:10.319786 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a3f1e02f-d9d7-4a78-9eeb-da08ec29618d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1326 microversion: 2.1 time: 0.103527 Sep 14 20:01:10.320362 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 382/770] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:10 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:10.583198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:10.585503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:10.592548 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:10.593037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:10.593472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:10.594230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:10.594685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:10.595109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:10.629741 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-04e44e5c-8ba4-4647-80ed-15fc2f186f13 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050647 Sep 14 20:01:10.634528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 389/771] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:01:10 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:10.752305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-4e44d559-73b2-4e47-82a0-9b2a3892b612 req-efeaa4e1-c023-49b7-916f-366ca9d32e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e", "tag": "418e2560-6dba-4405-b1ca-657319b5665c"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:10.762344 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4e44d559-73b2-4e47-82a0-9b2a3892b612 req-efeaa4e1-c023-49b7-916f-366ca9d32e15 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:10.762827 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4e44d559-73b2-4e47-82a0-9b2a3892b612 req-efeaa4e1-c023-49b7-916f-366ca9d32e15 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:10.763261 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4e44d559-73b2-4e47-82a0-9b2a3892b612 req-efeaa4e1-c023-49b7-916f-366ca9d32e15 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:10.774243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-4e44d559-73b2-4e47-82a0-9b2a3892b612 req-efeaa4e1-c023-49b7-916f-366ca9d32e15 service nova] Creating event network-changed:418e2560-6dba-4405-b1ca-657319b5665c for instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e on hv-cinder-83976 Sep 14 20:01:10.780189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-4e44d559-73b2-4e47-82a0-9b2a3892b612 req-efeaa4e1-c023-49b7-916f-366ca9d32e15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085271 Sep 14 20:01:10.780787 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 383/772] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:11.342709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:11.343419 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:11.350156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:11.350832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:11.351458 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:11.352273 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:11.352802 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:11.353299 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:11.387076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:11.387567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:11.388058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:11.388619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'fault' on Instance uuid f70804c4-376b-4606-bd6f-4414c9892629 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:11.429670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:11.438074 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5176140a-658e-49bb-b800-c4bfb6015f3f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 200 len: 1326 microversion: 2.1 time: 0.099300 Sep 14 20:01:11.438632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 390/773] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:11 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:11.642731 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:11.645024 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:11.651781 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:11.652255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:11.652682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:11.653367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:11.654092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:11.654515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:11.685318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-92af2fa8-f620-4658-a452-c448a6234021 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047091 Sep 14 20:01:11.685908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 384/774] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:01:11 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:12.461684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:12.462458 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:12.469270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:12.469748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:12.470329 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:12.470951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:12.471403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:12.471821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:12.485420 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] HTTP exception thrown: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Request method failure captured: Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 HTTP/1.1 Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHGiilxWoD4FTg9nekXuBhW1-7liAs-hfyDuo2saLPSKMBQunBkGnoiANwd7QUiqXFLNRgqdsGlc5W37RRTFv6syCzGol-rwwx3RzQOSDdEigbwbiWHwuY6Z4ZFz85JOIhbNV5oJBgGAjdh_5nnN0Cy5uIQztxTwoa12hPNcF6c5Sw Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:01:12.487109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e52433815b1440de8bfe05dc7d14b7f5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}] Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 268dbf54f29c40d9a4daa772c44735d4 Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:01:12.488893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'f70804c4-376b-4606-bd6f-4414c9892629'} Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:01:12.496072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:01:12.497641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:12.499048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Returning 404 to user: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:01:12.499048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2608c30f-fdda-4baa-9615-dd18a865615e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 404 len: 111 microversion: 2.1 time: 0.030691 Sep 14 20:01:12.499048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 391/775] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:12 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:01:12.499373 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-12eaeb42-4732-412f-9a8e-c850d5650a34 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '.version_select at 0x7f19e55a9d30>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:12.605587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-12eaeb42-4732-412f-9a8e-c850d5650a34 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420043711" status: 202 len: 0 microversion: 2.1 time: 0.111921 Sep 14 20:01:12.606285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 385/776] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 20:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420043711 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:12.697205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:12.700042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:12.708045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:12.708731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:12.708953 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:12.709888 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:12.710336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:12.710906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:12.742248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2899fa05-a0e9-4b46-9560-0925e5f90730 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048963 Sep 14 20:01:12.742824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 392/777] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:01:12 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:13.381582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-52b8b266-ae85-4266-9771-3a2ca966a4f6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'create', calling method: .version_select at 0x7f19e55da9d0>, body: {"keypair": {"name": "tempest-keypair-51860525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD5HDTKy60495AxyBVcqwlTxS4frSt4y2ZbTUr20YBZ5x3H+w0eP0otTjDIz0uiU1qmLzJq4bNOP+boiP7IUMvox+EylG1L/hjrsKamL/oe0zBywS9rUFbVMixLpJJ6xg=="}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:13.404090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-52b8b266-ae85-4266-9771-3a2ca966a4f6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:01:13.404090 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-52b8b266-ae85-4266-9771-3a2ca966a4f6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for user 268dbf54f29c40d9a4daa772c44735d4 and project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:01:13.468649 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-52b8b266-ae85-4266-9771-3a2ca966a4f6 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.091595 Sep 14 20:01:13.469246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 386/778] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 20:01:13 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:13.755686 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:13.757951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:13.765003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:13.765493 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:13.765961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:13.766686 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:13.767145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:13.767587 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:13.800205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d6570924-1c1c-44a4-aa36-25b40ae42ddb tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048633 Sep 14 20:01:13.800769 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 393/779] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:01:13 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 20:01:13.894106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:13.896891 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:13.900604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:13.901679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:13.902136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:13.902819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:13.903404 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:13.903823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:13.936951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:01:14.307676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6a09ada7-7aa6-4ca8-bcfc-8c37a64a53ef tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 204 len: 0 microversion: 2.1 time: 0.417035 Sep 14 20:01:14.308295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 387/780] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:01:13 2022] DELETE /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:01:14.317983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:14.318642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:14.325273 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:14.325760 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:14.326225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:14.326905 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:14.327406 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:14.327833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:14.466004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:14.473740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cc381c3b-243c-4826-8a12-27cd3a0a806c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1689 microversion: 2.1 time: 0.161243 Sep 14 20:01:14.474328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 394/781] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:14 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:15.497209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:15.498056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:15.504599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:15.505092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:15.505717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:15.506455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:15.507009 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:15.507329 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:15.711692 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:15.720138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-04bf6ba4-224a-476f-9bd2-4fba85d8c7d2 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1689 microversion: 2.1 time: 0.227121 Sep 14 20:01:15.721070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 388/782] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:15 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:15.874216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-307473299", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "655d425e-28f4-45ba-a4d3-323f994e61e4"}], "security_groups": [{"name": "tempest-securitygroup--1562534871"}], "key_name": "tempest-keypair-51860525", "user_data": "}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:15.976013 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] validate_networks() for [('655d425e-28f4-45ba-a4d3-323f994e61e4', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:01:16.639796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:01:16.640225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:01:16.640705 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:01:16.641118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:01:16.641535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:01:16.650754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:16.651240 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:16.651674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:16.652415 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:16.652856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:16.653279 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:16.669625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:01:16.673574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Getting quotas for user 268dbf54f29c40d9a4daa772c44735d4 and project e52433815b1440de8bfe05dc7d14b7f5. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:01:16.685054 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:01:16.687351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:01:16.743856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:16.744469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:16.751213 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:16.752797 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:16.752797 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:16.753310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:16.753996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:16.754645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:16.814079 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-eca7fab5-d313-411b-aab9-0d418ec11cf3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.943721 Sep 14 20:01:16.821572 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 395/783] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:01:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:01:16.831166 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-80d8f29f-2b45-485f-a557-f2738fc64703 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:16.832845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-80d8f29f-2b45-485f-a557-f2738fc64703 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:16.895248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-80d8f29f-2b45-485f-a557-f2738fc64703 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:16.899976 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:16.905481 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-80d8f29f-2b45-485f-a557-f2738fc64703 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1235 microversion: 2.1 time: 0.081190 Sep 14 20:01:16.906457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 396/784] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:16 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:16.909693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1a4db683-49d2-4c2e-8798-08a50e535067 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1689 microversion: 2.1 time: 0.169574 Sep 14 20:01:16.910290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 389/785] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:16 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:17.934628 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:17.935134 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:17.940114 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:17.940843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:17.941911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:17.942463 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:17.943074 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:17.944018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:17.944961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:17.945332 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:17.948281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:17.948876 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:17.949418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:17.950264 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:17.950831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:17.951355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:18.014251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:18.024423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e0562615-cd54-4cfa-8cb7-a4442940a634 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1239 microversion: 2.1 time: 0.093939 Sep 14 20:01:18.025634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 397/786] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:17 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:18.101143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:18.108861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d638d8e8-a6b2-41a4-a67f-91ba172d9b33 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1689 microversion: 2.1 time: 0.173556 Sep 14 20:01:18.109411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 390/787] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:17 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:19.050050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:19.051269 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:19.060502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:19.060502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:19.060502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:19.060502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:19.060922 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:19.061274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:19.125364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:19.134934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:19.136031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:19.144059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:19.144551 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:19.144989 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:19.145685 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:19.148385 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:19.148863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:19.165219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9ce77df8-ac3d-4946-9652-b312dbc6325e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1239 microversion: 2.1 time: 0.118954 Sep 14 20:01:19.166009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 398/788] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:19 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1239 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:19.169842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:19.171215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1373557971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1022979039", "security_groups": [{"name": "tempest-secgroup-smoke-1990492513"}], "networks": [{"uuid": "4e5a9883-81c0-4286-88c4-773fbb8737c5"}], "block_device_mapping_v2": [{"uuid": "dbf24449-8877-46e5-a111-0d055199ee3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:19.299600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:19.307475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4f5e7133-5e55-4ebc-93e3-592ac1c7d0d9 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1689 microversion: 2.1 time: 0.176610 Sep 14 20:01:19.308047 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 391/789] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:19 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:19.309895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] validate_networks() for [('4e5a9883-81c0-4286-88c4-773fbb8737c5', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:01:19.675946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:01:19.676369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:01:19.676841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:01:19.677243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:01:19.677647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:01:19.686984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:19.687461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:19.687888 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:19.688639 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:19.689084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:19.689502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:19.706185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Getting quotas for project 2d5c2273800e43a096bce8807c31fbf5. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:01:19.710363 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Getting quotas for user 04af0db8835d427092c076d35b3e67d9 and project 2d5c2273800e43a096bce8807c31fbf5. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:01:19.712586 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:19.766682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:01:19.768764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbf24449-8877-46e5-a111-0d055199ee3f',volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:01:20.188177 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:20.188835 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:20.195294 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:20.195782 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:20.196225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:20.196919 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:20.197376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:20.197877 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:20.262917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:20.270584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-22be98e6-afa2-48c0-ac9e-df45e5de345c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1239 microversion: 2.1 time: 0.086281 Sep 14 20:01:20.273211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 392/790] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:20 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:20.331033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:20.331643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:20.337784 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:20.338556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:20.339258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:20.339942 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:20.340392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:20.340814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:20.472433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7494224b-0681-4afe-8ce5-d66941d40a59 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.305350 Sep 14 20:01:20.476115 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 399/791] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:01:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:01:20.483056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:20.486631 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-aa84bce2-8978-4bb9-a3c8-cab45d5ca93e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:20.487414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-aa84bce2-8978-4bb9-a3c8-cab45d5ca93e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:20.491677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d26f5d57-3c6f-4ac8-bde3-9b868698fc6c tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1689 microversion: 2.1 time: 0.164402 Sep 14 20:01:20.492499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 393/792] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:20 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:20.560193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aa84bce2-8978-4bb9-a3c8-cab45d5ca93e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:20.568426 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-aa84bce2-8978-4bb9-a3c8-cab45d5ca93e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1089 microversion: 2.1 time: 0.087206 Sep 14 20:01:20.569095 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 400/793] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:20 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1089 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:21.293713 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:21.294373 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:21.305656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:21.306502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:21.306950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:21.307617 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:21.308168 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:21.308639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:21.387751 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:21.396883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ff0a65b2-a998-41e7-9146-10a4336e2888 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1287 microversion: 2.1 time: 0.107129 Sep 14 20:01:21.397573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 394/794] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:21 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:21.516326 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:21.517578 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:21.524776 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:21.525261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:21.525918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:21.526804 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:21.527310 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:21.527734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:21.593084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:21.593697 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:21.603915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:21.605109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:21.605700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:21.606576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:21.607181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:21.607761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:21.721411 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:21.727159 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:21.732010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a2ef6211-1eba-44a4-94f0-f689b816385e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1622 microversion: 2.1 time: 0.219488 Sep 14 20:01:21.734620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 401/795] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:21 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1622 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:21.746950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3460c4bc-caa3-4428-afbf-29a95df0bfb4 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1139 microversion: 2.1 time: 0.158122 Sep 14 20:01:21.750814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 395/796] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:21 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1139 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:21.755813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-af3554f5-5786-4547-8189-b0e4fd6c1d01 req-a5ab4923-339b-48ea-84b0-e29f65cdc5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75fbf44-86a1-4b99-97a3-d7e04415ac72", "name": "network-vif-deleted", "tag": "ae006861-47e1-449b-b3aa-d229e77ec13d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:21.776437 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-af3554f5-5786-4547-8189-b0e4fd6c1d01 req-a5ab4923-339b-48ea-84b0-e29f65cdc5ad service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:21.777449 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-af3554f5-5786-4547-8189-b0e4fd6c1d01 req-a5ab4923-339b-48ea-84b0-e29f65cdc5ad service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:21.784138 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-af3554f5-5786-4547-8189-b0e4fd6c1d01 req-a5ab4923-339b-48ea-84b0-e29f65cdc5ad service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:21.801714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-af3554f5-5786-4547-8189-b0e4fd6c1d01 req-a5ab4923-339b-48ea-84b0-e29f65cdc5ad service nova] Creating event network-vif-deleted:ae006861-47e1-449b-b3aa-d229e77ec13d for instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 on hv-cinder-83976 Sep 14 20:01:21.807245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-af3554f5-5786-4547-8189-b0e4fd6c1d01 req-a5ab4923-339b-48ea-84b0-e29f65cdc5ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059755 Sep 14 20:01:21.808898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 402/797] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:01:22.424942 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:22.425991 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:22.432937 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:22.433631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:22.434142 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:22.434877 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:22.435299 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:22.435719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:22.680045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:22.692891 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1dca865e-8c6e-41fa-a23b-21b90c985de9 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.271759 Sep 14 20:01:22.693556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 396/798] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:22 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:22.759632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:22.761194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:22.768509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:22.769261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:22.769888 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:22.770915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:22.771534 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:22.772190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:22.779402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:22.780025 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:22.797328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:22.800842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:22.800842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:22.800842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:22.800842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:22.801430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:22.848937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:22.849433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:22.849897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:22.850355 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'fault' on Instance uuid c75fbf44-86a1-4b99-97a3-d7e04415ac72 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:22.901512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:22.909317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3386f181-b508-4676-950c-684ae51c9a0b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1336 microversion: 2.1 time: 0.154767 Sep 14 20:01:22.910586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:22.928780 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-907ab9c8-6718-4f41-a275-97c19c6268db tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1187 microversion: 2.1 time: 0.148806 Sep 14 20:01:22.928780 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 397/799] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:22 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1187 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:22.934015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 403/800] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:22 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1336 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:23.717689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:23.719122 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:23.721171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=4 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:23.730818 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:23.731316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:23.733139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:23.733139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:23.733139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:23.733418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:23.816425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-7a3b4823-aee1-4d9b-9fe3-3ede0205c08a req-9ef03ff4-fd08-4993-a94f-bb96b84f3787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8067613a-f4df-44e1-9aa6-b6d7a39a119c", "tag": "4029e4db-b1ef-4868-b253-8130c5772587"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:23.832205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-7a3b4823-aee1-4d9b-9fe3-3ede0205c08a req-9ef03ff4-fd08-4993-a94f-bb96b84f3787 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:23.833205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-7a3b4823-aee1-4d9b-9fe3-3ede0205c08a req-9ef03ff4-fd08-4993-a94f-bb96b84f3787 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:23.833898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-7a3b4823-aee1-4d9b-9fe3-3ede0205c08a req-9ef03ff4-fd08-4993-a94f-bb96b84f3787 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:23.852627 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-7a3b4823-aee1-4d9b-9fe3-3ede0205c08a req-9ef03ff4-fd08-4993-a94f-bb96b84f3787 service nova] Creating event network-changed:4029e4db-b1ef-4868-b253-8130c5772587 for instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c on hv-cinder-83976 Sep 14 20:01:23.863317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-7a3b4823-aee1-4d9b-9fe3-3ede0205c08a req-9ef03ff4-fd08-4993-a94f-bb96b84f3787 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047425 Sep 14 20:01:23.865255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 404/801] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:01:23.939225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:23.940006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:23.946754 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:23.947520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:23.947960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:23.948786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:23.949244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:23.949662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:23.983302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:23.983791 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:23.984224 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:23.984714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'fault' on Instance uuid c75fbf44-86a1-4b99-97a3-d7e04415ac72 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:24.060610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:24.070925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-750f8fd8-13b8-40f4-8ccb-54cf52a60f1e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 200 len: 1336 microversion: 2.1 time: 0.135583 Sep 14 20:01:24.072201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 405/802] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:23 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 1336 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:24.077774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:24.082774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:24.084901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:24.085577 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:24.086224 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:24.087238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:24.087853 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:24.088285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:24.128522 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:24.141127 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fe7cccc2-eeaa-4102-a890-4ece3cad2458 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.428079 Sep 14 20:01:24.142389 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 398/803] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:23 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:24.189248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:24.207533 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-72ad2230-63f7-49e6-8811-efb876c2c86e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1205 microversion: 2.1 time: 0.133217 Sep 14 20:01:24.208803 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 406/804] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:24 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1205 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:25.097700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:25.098609 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: c75fbf44-86a1-4b99-97a3-d7e04415ac72] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:25.106628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:25.107291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:25.107841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:25.108686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:25.109260 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:25.109792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:25.125002 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] HTTP exception thrown: Instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 could not be found. Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Request method failure captured: Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 HTTP/1.1 Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHC0aHoqsUh3NYXw5S0NjtScfmAhqtQ_7KCs3E1xPXs3PjDdqG8hX__jCvqyY4bBMIxizbZDC30sI_OwS4Wfmd9lQT6fYu0i6zyak_x6jUWLxNCZG6MWb_mmYsjlb16N-PdYKBv5ddu76FV04I_OfIL3Ze4_gMIAwPkH5S3sWEpLdQ Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:01:25.126946 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1dc64fa9e8e422fab6b3a66a29278ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}] Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 766dd5a650fc4855980250969854f08d Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 could not be found. Sep 14 20:01:25.128690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'c75fbf44-86a1-4b99-97a3-d7e04415ac72'} Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 could not be found. Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:01:25.129653 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 could not be found. Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 could not be found. Sep 14 20:01:25.132221 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:01:25.134339 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Returning 404 to user: Instance c75fbf44-86a1-4b99-97a3-d7e04415ac72 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:01:25.134339 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-eb41d0c0-c2c4-4dca-b721-7aa3c8f99ef1 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72" status: 404 len: 111 microversion: 2.1 time: 0.037585 Sep 14 20:01:25.141107 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-99569171-0256-40bb-8ce3-2b6f89cb265d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '.version_select at 0x7f19e8e8a550>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:25.146381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 399/805] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:25 2022] GET /compute/v2.1/servers/c75fbf44-86a1-4b99-97a3-d7e04415ac72 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:01:25.164968 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:25.165735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:25.172285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:25.172879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:25.173392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:25.174250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:25.174779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:25.175281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:25.268556 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-99569171-0256-40bb-8ce3-2b6f89cb265d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226787762" status: 202 len: 0 microversion: 2.1 time: 0.132570 Sep 14 20:01:25.269228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 407/806] 10.222.0.42 () {58 vars in 1221 bytes} [Wed Sep 14 20:01:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226787762 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:01:25.278086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:25.278949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:25.285095 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:25.285667 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:25.286252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:25.287020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:25.287708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:25.288296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:25.368286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:25.376951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e3f10365-c470-4e84-a92f-f7204512794d tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.215956 Sep 14 20:01:25.377859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 400/807] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:25 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:25.430811 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:25.439334 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b9bace57-830a-4840-80cf-a0107adb3677 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1273 microversion: 2.1 time: 0.165929 Sep 14 20:01:25.439940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 408/808] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:25 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:25.834267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-35269b41-4c8e-4b67-8993-1742c1a1bd7d req-4a4b9724-2899-4e49-8044-569cd3f96b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16963b9-9ad4-4a98-b1bc-eeca734dab8c", "tag": "ef0f455b-8116-43f0-96ef-d2554406ee03"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:25.845892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-35269b41-4c8e-4b67-8993-1742c1a1bd7d req-4a4b9724-2899-4e49-8044-569cd3f96b34 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:25.846677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-35269b41-4c8e-4b67-8993-1742c1a1bd7d req-4a4b9724-2899-4e49-8044-569cd3f96b34 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:25.847268 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-35269b41-4c8e-4b67-8993-1742c1a1bd7d req-4a4b9724-2899-4e49-8044-569cd3f96b34 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:25.875643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-35269b41-4c8e-4b67-8993-1742c1a1bd7d req-4a4b9724-2899-4e49-8044-569cd3f96b34 service nova] Creating event network-changed:ef0f455b-8116-43f0-96ef-d2554406ee03 for instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c on hv-cinder-83976 Sep 14 20:01:25.893361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-35269b41-4c8e-4b67-8993-1742c1a1bd7d req-4a4b9724-2899-4e49-8044-569cd3f96b34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061277 Sep 14 20:01:25.893576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 401/809] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:26.400520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:26.401219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:26.407532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:26.408017 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:26.408447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:26.409139 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:26.409592 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:26.410059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:26.414164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:26.466770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:26.467485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:26.473831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:26.474386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:26.474831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:26.475528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:26.476420 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:26.476539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:26.569710 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:26.577893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6ae81e5e-9d92-4f68-ba25-1fd86c583c3e tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.181101 Sep 14 20:01:26.578512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 409/810] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:26 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:26.633203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:26.641493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-333beb2a-423c-4089-8780-7575aa0d52f2 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1273 microversion: 2.1 time: 0.179773 Sep 14 20:01:26.642408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 402/811] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:26 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:27.601112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:27.601775 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:27.608824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:27.609275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:27.609707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:27.610479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:27.610925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:27.611341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:27.663981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:27.664660 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:27.671316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:27.671792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:27.672220 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:27.672900 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:27.673359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:27.673777 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:27.746713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:27.754378 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-661173dc-feb2-47c9-947b-e065f2d06b27 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.157053 Sep 14 20:01:27.754941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 410/812] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:27 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:27.809040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:27.819016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bceda050-86aa-4489-bed6-0af5ac219a15 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.158762 Sep 14 20:01:27.819809 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 403/813] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:27 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:28.777900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:28.778515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:28.784926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:28.785420 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:28.785880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:28.786569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:28.787024 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:28.805548 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:28.845251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:28.845891 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:28.852676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:28.854391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:28.854391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:28.864013 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:28.865914 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:28.866575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:28.931042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:28.938808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5a8c54b5-7500-42fa-bd0f-9812c1c49f74 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.165483 Sep 14 20:01:28.941876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 411/814] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:28 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:29.022556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:29.030975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-76d6f008-34d4-4692-be7d-2b3273353fcf tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.189571 Sep 14 20:01:29.031548 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 404/815] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:28 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:29.041462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:29.041920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:29.048119 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:29.048602 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:29.049038 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:29.049727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:29.050208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:29.050628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:29.076560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:01:29.142119 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-9d049984-8bce-4927-88e1-c52c4a76cf43 req-9b012b58-0fe1-40c0-a210-e7c0db6ee51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8067613a-f4df-44e1-9aa6-b6d7a39a119c", "name": "network-vif-plugged", "status": "completed", "tag": "4029e4db-b1ef-4868-b253-8130c5772587"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:29.151474 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9d049984-8bce-4927-88e1-c52c4a76cf43 req-9b012b58-0fe1-40c0-a210-e7c0db6ee51b service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:29.151992 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9d049984-8bce-4927-88e1-c52c4a76cf43 req-9b012b58-0fe1-40c0-a210-e7c0db6ee51b service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:29.152422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9d049984-8bce-4927-88e1-c52c4a76cf43 req-9b012b58-0fe1-40c0-a210-e7c0db6ee51b service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:29.162973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-9d049984-8bce-4927-88e1-c52c4a76cf43 req-9b012b58-0fe1-40c0-a210-e7c0db6ee51b service nova] Creating event network-vif-plugged:4029e4db-b1ef-4868-b253-8130c5772587 for instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c on hv-cinder-83976 Sep 14 20:01:29.167937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-9d049984-8bce-4927-88e1-c52c4a76cf43 req-9b012b58-0fe1-40c0-a210-e7c0db6ee51b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227474 Sep 14 20:01:29.168511 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 412/816] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:29.381731 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ce39b176-7b62-4c9f-9f58-eb8a5396cea6 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 204 len: 0 microversion: 2.1 time: 0.348585 Sep 14 20:01:29.382348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 405/817] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:01:29 2022] DELETE /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:01:29.391671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:29.392374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:29.398699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:29.399181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:29.399616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:29.400303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:29.400758 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:29.401183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:29.533784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:29.541560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bdb9d3e0-4535-40af-8230-c44ee0d7be7d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1506 microversion: 2.1 time: 0.154246 Sep 14 20:01:29.542682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 413/818] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:29 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:29.962903 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:29.964122 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:29.970446 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:29.970926 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:29.971355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:29.972035 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:29.972479 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:29.972898 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:30.054204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:30.054893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:30.056957 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:30.062453 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:30.063051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:30.063498 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:30.064202 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:30.064662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:30.065092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:30.100423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:30.108913 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ce74714c-72f9-4d82-bd01-a264eed360ad tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.150164 Sep 14 20:01:30.109535 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 406/819] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:29 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:30.193721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:30.201286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e366d35d-2ab2-4662-91f0-0f9e357cc827 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.151064 Sep 14 20:01:30.201861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 414/820] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:30 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:30.565400 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:30.566072 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:30.572034 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:30.572524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:30.573461 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:30.574179 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:30.574633 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:30.575060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:30.708668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:30.712218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:30.716716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-27f8508a-a10c-4f79-9bd7-53ccd02f855f tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1506 microversion: 2.1 time: 0.155173 Sep 14 20:01:30.717277 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 407/821] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:30 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:31.131644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:31.132248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:31.134154 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=16 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:31.139325 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:31.139810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:31.140249 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:31.140941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:31.141390 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:31.141822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:31.225716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:31.226431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:31.234166 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:31.234652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:31.235084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:31.236111 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:31.236246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:31.236689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:31.321790 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:31.329957 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6f5427ab-820c-4b7d-be5d-4958fd9da734 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1361 microversion: 2.1 time: 0.202092 Sep 14 20:01:31.330596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 415/822] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:31 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:31.379298 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:31.387105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2b043724-f4cf-45b1-b638-8a693111d7f6 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.165694 Sep 14 20:01:31.387675 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 408/823] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:31 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:31.519532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-7bd93f44-4e87-4807-9926-972b9069a2d7 req-335b1b8f-bfbb-40b0-9649-46f0c2d06e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceccccd7-9977-43ce-ad4f-331394d25cf9", "name": "network-vif-deleted", "tag": "0093986a-f452-4790-8240-0584e1a07800"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:31.529576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-7bd93f44-4e87-4807-9926-972b9069a2d7 req-335b1b8f-bfbb-40b0-9649-46f0c2d06e74 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:31.530093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-7bd93f44-4e87-4807-9926-972b9069a2d7 req-335b1b8f-bfbb-40b0-9649-46f0c2d06e74 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:31.530529 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-7bd93f44-4e87-4807-9926-972b9069a2d7 req-335b1b8f-bfbb-40b0-9649-46f0c2d06e74 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:31.541437 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-7bd93f44-4e87-4807-9926-972b9069a2d7 req-335b1b8f-bfbb-40b0-9649-46f0c2d06e74 service nova] Creating event network-vif-deleted:0093986a-f452-4790-8240-0584e1a07800 for instance ceccccd7-9977-43ce-ad4f-331394d25cf9 on hv-cinder-83976 Sep 14 20:01:31.547140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-7bd93f44-4e87-4807-9926-972b9069a2d7 req-335b1b8f-bfbb-40b0-9649-46f0c2d06e74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031490 Sep 14 20:01:31.547921 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 416/824] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:31.742227 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:31.742768 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:31.748733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:31.754376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:31.754376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:31.754376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:31.754376 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:31.754810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:31.814238 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:31.822273 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-da25f2d2-a380-430d-abea-34d244fc5d58 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1292 microversion: 2.1 time: 0.084052 Sep 14 20:01:31.822851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 409/825] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:31 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:32.355377 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:32.356113 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:32.362392 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.362869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.363299 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.363982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.364425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.365025 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.410288 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:32.410845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:32.417004 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.417492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.417956 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.418969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.419429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.419858 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.500311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:32.508167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-584fec4a-ffd7-4db6-94af-4748b3bc37fa tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1547 microversion: 2.1 time: 0.157485 Sep 14 20:01:32.508736 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 417/826] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:32 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:32.530804 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:32.531416 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:32.537392 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.538010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.538553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.539321 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.539844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.540336 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.560586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:32.568184 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8fbce3de-9873-4ee7-9eb8-713e4683a09b tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.162171 Sep 14 20:01:32.568752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 410/827] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:32 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:32.618119 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f111e118-8c92-4e70-b838-54709db601a3 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091093 Sep 14 20:01:32.618708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 418/828] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 20:01:32 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:01:32.847311 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:32.847930 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:32.853916 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.854407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.854843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.855539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.856068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.856889 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.891476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:32.891961 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:32.892405 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:32.892855 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'fault' on Instance uuid ceccccd7-9977-43ce-ad4f-331394d25cf9 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:32.933167 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:32.940962 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d6e0f0a5-455d-4e82-b265-a1ddb7ed7934 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 200 len: 1311 microversion: 2.1 time: 0.097661 Sep 14 20:01:32.941620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 411/829] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:32 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:33.591854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:33.592714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:33.600615 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:33.601110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:33.601551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:33.602277 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:33.603245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:33.603245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:33.814130 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:33.822503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8872b208-4418-4d75-9746-f54c1e56624d tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.235037 Sep 14 20:01:33.823284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 419/830] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:33 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:33.957815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-b0ac8418-8882-4b33-906a-1780795e96f0 req-d5409e2b-42db-490f-b295-80156dc2ea11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8067613a-f4df-44e1-9aa6-b6d7a39a119c", "tag": "4029e4db-b1ef-4868-b253-8130c5772587"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:33.968383 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:33.968688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: ceccccd7-9977-43ce-ad4f-331394d25cf9] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:33.970307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-b0ac8418-8882-4b33-906a-1780795e96f0 req-d5409e2b-42db-490f-b295-80156dc2ea11 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:33.971016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-b0ac8418-8882-4b33-906a-1780795e96f0 req-d5409e2b-42db-490f-b295-80156dc2ea11 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:33.971506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-b0ac8418-8882-4b33-906a-1780795e96f0 req-d5409e2b-42db-490f-b295-80156dc2ea11 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:33.976256 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:33.976761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:33.977195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:33.977929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:33.978387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:33.978806 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:33.984190 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-b0ac8418-8882-4b33-906a-1780795e96f0 req-d5409e2b-42db-490f-b295-80156dc2ea11 service nova] Creating event network-changed:4029e4db-b1ef-4868-b253-8130c5772587 for instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c on hv-cinder-83976 Sep 14 20:01:33.989369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-b0ac8418-8882-4b33-906a-1780795e96f0 req-d5409e2b-42db-490f-b295-80156dc2ea11 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036397 Sep 14 20:01:33.990033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 412/831] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:33.996302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] HTTP exception thrown: Instance ceccccd7-9977-43ce-ad4f-331394d25cf9 could not be found. Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Request method failure captured: Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 HTTP/1.1 Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHC0aHoqsUh3NYXw5S0NjtScfmAhqtQ_7KCs3E1xPXs3PjDdqG8hX__jCvqyY4bBMIxizbZDC30sI_OwS4Wfmd9lQT6fYu0i6zyak_x6jUWLxNCZG6MWb_mmYsjlb16N-PdYKBv5ddu76FV04I_OfIL3Ze4_gMIAwPkH5S3sWEpLdQ Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:01:33.998945 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1dc64fa9e8e422fab6b3a66a29278ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}] Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 766dd5a650fc4855980250969854f08d Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance ceccccd7-9977-43ce-ad4f-331394d25cf9 could not be found. Sep 14 20:01:34.000588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'ceccccd7-9977-43ce-ad4f-331394d25cf9'} Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceccccd7-9977-43ce-ad4f-331394d25cf9 could not be found. Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:01:34.001524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceccccd7-9977-43ce-ad4f-331394d25cf9 could not be found. Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceccccd7-9977-43ce-ad4f-331394d25cf9 could not be found. Sep 14 20:01:34.003193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:34.005018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Returning 404 to user: Instance ceccccd7-9977-43ce-ad4f-331394d25cf9 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:01:34.005018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3085681e-4e5b-469e-b2a7-3b18b67e221d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9" status: 404 len: 111 microversion: 2.1 time: 0.037735 Sep 14 20:01:34.005018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 420/832] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:33 2022] GET /compute/v2.1/servers/ceccccd7-9977-43ce-ad4f-331394d25cf9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:01:34.010418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:34.013780 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:34.017791 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:34.018304 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:34.018739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:34.019426 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:34.019871 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:34.020294 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:34.052785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:01:34.301047 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:34.410068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-abefcf51-daf7-4155-bd59-d8d587a08a91 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 204 len: 0 microversion: 2.1 time: 0.403604 Sep 14 20:01:34.413993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 413/833] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:01:34 2022] DELETE /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 20:01:34.419857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:34.420597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:34.427104 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:34.427718 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:34.428251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:34.429193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:34.430068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:34.430745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:34.564297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:34.571972 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-06ac0f16-0ec3-420c-97e0-c4af51e2824e tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.156492 Sep 14 20:01:34.572538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 421/834] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:34 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:34.846888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:34.847610 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:34.859809 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:34.863693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:34.863693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:34.863693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:34.863693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:34.864234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:35.005302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:35.013702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-dc8105db-f05d-45dc-99b7-ba07bf8ef355 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.171499 Sep 14 20:01:35.014305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 414/835] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:34 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:35.595867 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:35.596596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:35.603049 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:35.603528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:35.603958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:35.604642 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:35.605089 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:35.605510 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:35.734802 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:35.742987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7c8478f6-eb81-451f-abd3-dd4a6033f582 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.150933 Sep 14 20:01:35.743551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 422/836] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:35 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:36.036972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:36.037542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:36.045140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:36.045630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:36.046098 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:36.046788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:36.047246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:36.047691 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:36.177815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:36.185371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-40c8e570-9416-464c-b08f-594f77d45f56 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.152427 Sep 14 20:01:36.185955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 415/837] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:36 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:36.645738 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:36.646313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:36.652783 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:36.653264 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:36.653731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:36.654488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:36.654938 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:36.655361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:36.679666 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9ca1821e-3369-4ebb-95e3-bee2751da81e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/ips" status: 200 len: 153 microversion: 2.20 time: 0.139876 Sep 14 20:01:36.680834 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 423/838] 10.222.0.42 () {60 vars in 1289 bytes} [Wed Sep 14 20:01:36 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/ips => generated 153 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 20:01:36.766417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:36.767129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:36.773845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:36.773845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:36.774279 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:36.774982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:36.775498 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:36.775933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:36.913003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:36.922516 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-be0b2775-9674-40d9-84ec-a8c13633080d tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1522 microversion: 2.1 time: 0.159921 Sep 14 20:01:36.931727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 416/839] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:36 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:36.965193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-c689b681-5768-4bf0-812f-aa887e168c24 req-318b78ac-d3f6-4e73-9329-2766882b8c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16963b9-9ad4-4a98-b1bc-eeca734dab8c", "name": "network-vif-plugged", "status": "completed", "tag": "ef0f455b-8116-43f0-96ef-d2554406ee03"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:36.975515 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c689b681-5768-4bf0-812f-aa887e168c24 req-318b78ac-d3f6-4e73-9329-2766882b8c19 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:36.976132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c689b681-5768-4bf0-812f-aa887e168c24 req-318b78ac-d3f6-4e73-9329-2766882b8c19 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:36.976568 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c689b681-5768-4bf0-812f-aa887e168c24 req-318b78ac-d3f6-4e73-9329-2766882b8c19 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:36.988604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-c689b681-5768-4bf0-812f-aa887e168c24 req-318b78ac-d3f6-4e73-9329-2766882b8c19 service nova] Creating event network-vif-plugged:ef0f455b-8116-43f0-96ef-d2554406ee03 for instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c on hv-cinder-83976 Sep 14 20:01:36.993366 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-c689b681-5768-4bf0-812f-aa887e168c24 req-318b78ac-d3f6-4e73-9329-2766882b8c19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Sep 14 20:01:36.994161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 424/840] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:37.208160 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:37.208774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:37.216009 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:37.216503 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:37.216944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:37.217670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:37.218169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:37.218602 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:37.374704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:37.383200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-04164fc0-4dc7-487c-ab4f-981c6eeeb583 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.179071 Sep 14 20:01:37.384339 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 417/841] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:37 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:37.427220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-dd64d5f5-9af7-44c1-b3e8-8fed6dab1fdc req-7f7cf541-f2cd-4c37-9931-ecdd2f45984d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb97b57-3da3-4808-904f-c0573b681648", "name": "network-vif-deleted", "tag": "ab2b0c1b-d779-4157-a89f-cb7977ee37dc"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:37.441546 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-dd64d5f5-9af7-44c1-b3e8-8fed6dab1fdc req-7f7cf541-f2cd-4c37-9931-ecdd2f45984d service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:37.441546 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-dd64d5f5-9af7-44c1-b3e8-8fed6dab1fdc req-7f7cf541-f2cd-4c37-9931-ecdd2f45984d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:37.442170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-dd64d5f5-9af7-44c1-b3e8-8fed6dab1fdc req-7f7cf541-f2cd-4c37-9931-ecdd2f45984d service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:37.458258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-dd64d5f5-9af7-44c1-b3e8-8fed6dab1fdc req-7f7cf541-f2cd-4c37-9931-ecdd2f45984d service nova] Creating event network-vif-deleted:ab2b0c1b-d779-4157-a89f-cb7977ee37dc for instance 6cb97b57-3da3-4808-904f-c0573b681648 on hv-cinder-83976 Sep 14 20:01:37.464604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-dd64d5f5-9af7-44c1-b3e8-8fed6dab1fdc req-7f7cf541-f2cd-4c37-9931-ecdd2f45984d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043689 Sep 14 20:01:37.465503 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 425/842] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:37.945921 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:37.946535 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:37.952619 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:37.953113 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:37.953548 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:37.954270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:37.954726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:37.955171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:37.988819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:37.989214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:37.989651 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:37.990125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'fault' on Instance uuid 6cb97b57-3da3-4808-904f-c0573b681648 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:38.030155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:38.037719 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c25c7f07-088f-4cc1-a1ed-ad248b770942 tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1312 microversion: 2.1 time: 0.095759 Sep 14 20:01:38.038316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 418/843] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:37 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:38.411517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:38.412394 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:38.418899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:38.419378 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:38.419812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:38.420496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:38.421113 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:38.421539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:38.557220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:38.566026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ae818b4a-be84-485c-b94c-34d88d1edcd0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1261 microversion: 2.1 time: 0.158561 Sep 14 20:01:38.577855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 426/844] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:38 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:01:38.944431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:38.944985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:38.950997 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:38.952053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:38.953403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:38.954172 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:38.954646 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:38.955074 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:38.981070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lazy-loading 'flavor' on Instance uuid 2d406a90-e67e-4623-9697-11b9ed133316 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:39.061102 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:39.061709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:39.068187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.068791 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.069232 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.069962 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.070423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.070846 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.102964 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.103349 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.103781 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.104215 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lazy-loading 'fault' on Instance uuid 6cb97b57-3da3-4808-904f-c0573b681648 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:01:39.145091 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766dd5a650fc4855980250969854f08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1dc64fa9e8e422fab6b3a66a29278ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:39.153276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0870fbfe-03ae-4092-a768-00faee4a18fa tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 200 len: 1312 microversion: 2.1 time: 0.096110 Sep 14 20:01:39.153846 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 427/845] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:39 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:39.588874 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:39.589478 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:39.597065 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.597582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.598048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.603268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.603268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.603268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.735671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:39.743872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-66ad433f-ad6f-4935-a7a3-eb9506d0554f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1445 microversion: 2.1 time: 0.158996 Sep 14 20:01:39.747625 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 428/846] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:39 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:39.765238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:39.765856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:39.771338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.771812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.772237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.772974 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.773766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.774205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.793272 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:39.798888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a2176576-b917-435c-9cf5-c40c608126f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/action" status: 202 len: 0 microversion: 2.20 time: 0.858411 Sep 14 20:01:39.799555 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 419/847] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 20:01:38 2022] POST /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:01:39.807987 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:39.808923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:39.815408 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.815831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.816266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.816964 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:39.817413 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:39.817861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:39.928157 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:39.936341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e3c52505-6780-4c09-b0ab-fe187512e271 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1445 microversion: 2.1 time: 0.174578 Sep 14 20:01:39.937131 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 429/848] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:39 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:01:39.960029 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:39.964879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:39.970502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:39.972061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:39.973331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e0de6662-5d4c-4cdf-8279-4df809aa146c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.169388 Sep 14 20:01:39.973920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 420/849] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:39 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:40.176479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:40.177230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] [instance: 6cb97b57-3da3-4808-904f-c0573b681648] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:40.183780 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:40.184258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:40.184688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:40.185382 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:40.185849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:40.186268 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:40.200826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] HTTP exception thrown: Instance 6cb97b57-3da3-4808-904f-c0573b681648 could not be found. Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Request method failure captured: Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 HTTP/1.1 Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHC0aHoqsUh3NYXw5S0NjtScfmAhqtQ_7KCs3E1xPXs3PjDdqG8hX__jCvqyY4bBMIxizbZDC30sI_OwS4Wfmd9lQT6fYu0i6zyak_x6jUWLxNCZG6MWb_mmYsjlb16N-PdYKBv5ddu76FV04I_OfIL3Ze4_gMIAwPkH5S3sWEpLdQ Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:01:40.202506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e1dc64fa9e8e422fab6b3a66a29278ff", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e1dc64fa9e8e422fab6b3a66a29278ff"}]}] Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: e1dc64fa9e8e422fab6b3a66a29278ff Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-413947831 Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 766dd5a650fc4855980250969854f08d Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-413947831-project Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 6cb97b57-3da3-4808-904f-c0573b681648 could not be found. Sep 14 20:01:40.204093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '6cb97b57-3da3-4808-904f-c0573b681648'} Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb97b57-3da3-4808-904f-c0573b681648 could not be found. Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:01:40.205099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb97b57-3da3-4808-904f-c0573b681648 could not be found. Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb97b57-3da3-4808-904f-c0573b681648 could not be found. Sep 14 20:01:40.207891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:01:40.209423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] Returning 404 to user: Instance 6cb97b57-3da3-4808-904f-c0573b681648 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:01:40.209423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-918bba1d-e730-4f15-bac7-685aac70759b tempest-ServerRescueNegativeTestJSON-413947831 tempest-ServerRescueNegativeTestJSON-413947831-project] 10.222.0.42 "GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648" status: 404 len: 111 microversion: 2.1 time: 0.031338 Sep 14 20:01:40.209423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 430/850] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:01:40 2022] GET /compute/v2.1/servers/6cb97b57-3da3-4808-904f-c0573b681648 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:01:40.999842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:41.000449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:41.008089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:41.008585 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:41.009070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:41.009760 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:41.010234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:41.011153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:41.375761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:41.384207 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:41.386654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:41.387826 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c9d9e6da-f443-4f2a-9a82-e7f12106a60b tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.391952 Sep 14 20:01:41.388382 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 421/851] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:40 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:42.416436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:42.416436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:42.421991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:42.422483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:42.422916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:42.423605 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:42.424088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:42.424507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:42.717513 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:42.726402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:42.728105 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:42.730697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-aadc8489-6c25-46d2-ae6f-ed47fad896d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.320405 Sep 14 20:01:42.731634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 431/852] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:42 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:43.458359 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-5bc53c9b-005c-4587-9e21-22e6c725a416 req-b91ed5da-1391-4918-beda-75b9c63f40ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16963b9-9ad4-4a98-b1bc-eeca734dab8c", "tag": "ef0f455b-8116-43f0-96ef-d2554406ee03"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:43.469967 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5bc53c9b-005c-4587-9e21-22e6c725a416 req-b91ed5da-1391-4918-beda-75b9c63f40ec service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:43.471382 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5bc53c9b-005c-4587-9e21-22e6c725a416 req-b91ed5da-1391-4918-beda-75b9c63f40ec service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:43.472111 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5bc53c9b-005c-4587-9e21-22e6c725a416 req-b91ed5da-1391-4918-beda-75b9c63f40ec service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:43.486172 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-5bc53c9b-005c-4587-9e21-22e6c725a416 req-b91ed5da-1391-4918-beda-75b9c63f40ec service nova] Creating event network-changed:ef0f455b-8116-43f0-96ef-d2554406ee03 for instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c on hv-cinder-83976 Sep 14 20:01:43.492210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-5bc53c9b-005c-4587-9e21-22e6c725a416 req-b91ed5da-1391-4918-beda-75b9c63f40ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037282 Sep 14 20:01:43.493434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 422/853] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:43.758195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:43.758848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:43.771825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:43.773121 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:43.775317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:43.777093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:43.778464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:43.780744 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:44.023371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:44.033878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:44.039726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:44.041377 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6d14cd15-a00d-478a-86fe-b00c29ae8c0c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.287225 Sep 14 20:01:44.042541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 432/854] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:43 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:45.068770 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:45.069462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:45.076721 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:45.077222 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:45.078001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:45.078396 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:45.078854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:45.079286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:45.230814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:45.241105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:45.243148 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:45.244600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5e4697e5-94c2-4c94-8684-4fe1f09a75fb tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.180219 Sep 14 20:01:45.245365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 423/855] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:45 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:46.271498 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:46.272113 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:46.279132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:46.279620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:46.280050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:46.280741 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:46.281196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:46.281619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:46.414836 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:46.423319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:46.425026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:46.426437 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fc1da46d-dcb8-4126-8303-ab07ac05cc31 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.158940 Sep 14 20:01:46.427243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 433/856] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:46 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:47.453058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:47.453704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:47.460611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:47.461093 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:47.461546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:47.462297 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:47.462776 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:47.463218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:47.594101 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:47.602296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:47.603751 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:47.607039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f00605bf-91a7-420a-b235-f187461ad051 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.156917 Sep 14 20:01:47.607039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 424/857] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:47 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:48.574786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:48.575490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:48.583338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:48.583842 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:48.584282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:48.585167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:48.585832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:48.586307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:48.610820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9d635300-697b-454b-b520-f4e56e27cef1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/ips" status: 200 len: 150 microversion: 2.1 time: 0.040392 Sep 14 20:01:48.611394 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 434/858] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 20:01:48 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:48.632065 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:48.632760 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:48.639542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:48.640103 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:48.640611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:48.641386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:48.641941 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:48.642432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:48.794669 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:48.802810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:48.804261 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:48.805421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7f3d5891-a319-485f-b217-2784b0e40cd7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.177601 Sep 14 20:01:48.806043 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 425/859] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:48 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:49.830842 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:49.831452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:49.839323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:49.839816 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:49.843526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:49.843526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:49.843526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:49.843526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:50.015855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:50.024115 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:50.025583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:50.026784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-51e1d4f0-9765-4792-8448-ae8c58a41013 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.200021 Sep 14 20:01:50.027324 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 435/860] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:49 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:50.343628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1f3b49-a147-4d3d-8b06-35b2ee21129a"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:01:50.346051 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:50.352638 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:50.352908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:50.353348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:50.354070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:50.354519 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:50.354938 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:51.052726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:51.053517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:51.055645 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:01:51.060601 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:51.061084 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:51.061518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:51.062235 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:51.062688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:51.063110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:51.074292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9003a471-a046-4a80-89d1-d8103aa0af68 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734270 Sep 14 20:01:51.083258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 426/861] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 20:01:50 2022] POST /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:01:51.213441 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:51.224208 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:51.226730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:51.227322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-21668b76-9f56-403d-b5ea-eac2d0151f3f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.178461 Sep 14 20:01:51.228128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 436/862] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:51 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:01:52.255468 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:52.256176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:52.262700 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:52.263191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:52.263642 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:52.264342 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:52.264812 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:52.265257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:52.397776 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:52.406551 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:52.407998 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:52.409158 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9ca12b57-3868-4801-b432-70f0566b06ed tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.158480 Sep 14 20:01:52.419859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 427/863] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:52 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:53.439594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:53.440368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:53.451147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:53.451147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:53.451147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:53.451147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:53.452106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:53.452106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:53.581826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:53.590911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:53.592445 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:53.593599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-aee7daf4-33f0-44fc-b724-3190e02f5ab3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.158309 Sep 14 20:01:53.594187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 437/864] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:53 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:54.625741 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:54.626303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:54.632657 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:54.633136 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:54.633588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:54.634281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:54.634732 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:54.635152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:54.764823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:54.772874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:54.774347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:54.775515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a4b52732-37f4-4540-8a3d-dd3881ecaa0a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.153782 Sep 14 20:01:54.776058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 428/865] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:54 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:55.800676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:55.801326 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:55.807940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:55.808432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:55.808869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:55.809566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:55.810086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:55.810771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:55.943981 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:55.952773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:55.954227 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:55.955361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4938d926-df0a-4dd1-8df4-4d142b56334f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1746 microversion: 2.20 time: 0.158550 Sep 14 20:01:55.955972 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 438/866] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:55 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:56.982220 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:56.982821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:56.989331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:56.989827 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:56.990296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:56.990980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:56.991424 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:56.991842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:57.120414 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:57.128387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:57.129862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:57.131005 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-905ad3bc-acd8-44a7-89cf-37377154f17a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1746 microversion: 2.20 time: 0.153376 Sep 14 20:01:57.131564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 429/867] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:56 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:58.156090 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:58.156641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:58.162928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:58.163405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:58.163832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:58.164511 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:58.164956 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:58.165375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:58.291254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:58.299400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:58.300823 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:58.302023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f58899e6-3aac-427d-a07c-9f59be7af2f4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1746 microversion: 2.20 time: 0.150508 Sep 14 20:01:58.302565 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 439/868] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:58 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:01:59.328222 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:01:59.328840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:01:59.335622 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:59.336106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:59.336545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:59.337228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:01:59.337680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:01:59.338126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:01:59.466330 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:59.474687 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:59.476165 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:01:59.477325 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2b90db8d-888f-4535-978e-9625cd1fc867 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1746 microversion: 2.20 time: 0.153627 Sep 14 20:01:59.477924 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 430/869] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:01:59 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:00.503681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:00.504287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:00.510913 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:00.511332 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:00.511757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:00.512431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:00.512927 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:00.513344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:00.648736 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:00.658551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:00.660020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:00.661245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cb00cfb7-17bd-4b96-8852-1882311e3895 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.161350 Sep 14 20:02:00.661962 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 440/870] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:00 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:01.562361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-3f3cb7ba-a3c2-4e32-9867-2723ab32104c req-f6052316-84bb-4678-b2dd-e6af4c5b06d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d406a90-e67e-4623-9697-11b9ed133316", "name": "network-vif-plugged", "status": "completed", "tag": "25548a24-9696-4819-a2ea-b4a68fdf3d55"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:01.577570 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3f3cb7ba-a3c2-4e32-9867-2723ab32104c req-f6052316-84bb-4678-b2dd-e6af4c5b06d5 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:01.579226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3f3cb7ba-a3c2-4e32-9867-2723ab32104c req-f6052316-84bb-4678-b2dd-e6af4c5b06d5 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:01.579883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3f3cb7ba-a3c2-4e32-9867-2723ab32104c req-f6052316-84bb-4678-b2dd-e6af4c5b06d5 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:01.596812 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-3f3cb7ba-a3c2-4e32-9867-2723ab32104c req-f6052316-84bb-4678-b2dd-e6af4c5b06d5 service nova] Creating event network-vif-plugged:25548a24-9696-4819-a2ea-b4a68fdf3d55 for instance 2d406a90-e67e-4623-9697-11b9ed133316 on hv-cinder-83976 Sep 14 20:02:01.604293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-3f3cb7ba-a3c2-4e32-9867-2723ab32104c req-f6052316-84bb-4678-b2dd-e6af4c5b06d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050190 Sep 14 20:02:01.608248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 431/871] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:01.691807 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:01.692438 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:01.718954 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:01.719703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:01.720576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:01.724318 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:01.725244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:01.725862 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:01.864290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1f3b49-a147-4d3d-8b06-35b2ee21129a"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:01.869068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:01.898730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:01.899320 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:01.900239 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:01.901327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:01.901883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:01.902944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:01.941836 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:01.951563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:01.952997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:01.955181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a58f7edb-249d-47f8-8bc8-9f11984ca6a2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.267034 Sep 14 20:02:01.956302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 441/872] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:01 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:02.021918 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Invalid volume: volume 9c1f3b49-a147-4d3d-8b06-35b2ee21129a is already attached to instances: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: POST /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments HTTP/1.1 Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 74 Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:02:02.023655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {"volumeAttachment": {"volumeId": "9c1f3b49-a147-4d3d-8b06-35b2ee21129a"}} Sep 14 20:02:02.025125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Invalid volume: volume 9c1f3b49-a147-4d3d-8b06-35b2ee21129a is already attached to instances: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'server_id': '89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e', 'body': {'volumeAttachment': {'volumeId': '9c1f3b49-a147-4d3d-8b06-35b2ee21129a'}}} Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9c1f3b49-a147-4d3d-8b06-35b2ee21129a is already attached to instances: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:02:02.029710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9c1f3b49-a147-4d3d-8b06-35b2ee21129a is already attached to instances: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:02:02.030944 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9c1f3b49-a147-4d3d-8b06-35b2ee21129a is already attached to instances: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 400 to user: Invalid volume: volume 9c1f3b49-a147-4d3d-8b06-35b2ee21129a is already attached to instances: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-475ce672-1787-4426-b728-5e9acf1ef901 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.165359 Sep 14 20:02:02.032982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 432/873] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 20:02:01 2022] POST /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments => generated 174 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:02:02.104030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:02.104749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:02.110933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:02.111573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:02.111869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:02.112580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:02.113033 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:02.113457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:02.210888 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'services' on Instance uuid 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:02:02.466856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2b40c416-650d-408d-9341-19b6bcc1a128 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments/9c1f3b49-a147-4d3d-8b06-35b2ee21129a" status: 202 len: 0 microversion: 2.1 time: 0.366442 Sep 14 20:02:02.472134 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 442/874] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:02:02 2022] DELETE /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments/9c1f3b49-a147-4d3d-8b06-35b2ee21129a => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:02:02.476973 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:02.479185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:02.488116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:02.488855 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:02.494197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:02.494197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:02.494197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:02.494197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:02.525027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0e255a0e-4eaf-404e-9a8a-45fb1a164170 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052010 Sep 14 20:02:02.531369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 433/875] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:02:02 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:02.984327 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:02.985168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:02.991398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:02.992160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:02.992839 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:02.993739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:02.994427 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:02.995075 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:03.131219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:03.139700 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:03.141157 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:03.142518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-10624308-6db3-4670-bd0b-8984936eb2f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.162842 Sep 14 20:02:03.143337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 443/876] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:02 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:03.537768 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:03.540810 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:03.548403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:03.549016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:03.549469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:03.550400 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:03.550850 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:03.551475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:03.585765 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ab74bab0-68c3-406f-8ba2-f12ad9dc0950 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052310 Sep 14 20:02:03.586358 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 434/877] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:02:03 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:04.172120 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:04.172594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:04.179578 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:04.180127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:04.180616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:04.181346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:04.181829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:04.182248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:04.323934 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:04.358684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:04.358684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:04.358684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ace193ed-de37-4339-97b4-286400472375 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.168669 Sep 14 20:02:04.359024 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 444/878] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:04 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:04.598399 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:04.600705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:04.607880 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:04.608361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:04.608794 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:04.609478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:04.609962 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:04.610390 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:04.639336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b15df1ba-f319-4799-a117-af5c0cc990ec tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Sep 14 20:02:04.639904 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 435/879] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:02:04 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:05.382260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:05.383543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:05.390599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:05.391274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:05.391898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:05.393104 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:05.393736 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:05.396792 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:05.554677 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:05.563573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:05.565237 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:05.566632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-359bd002-750d-4852-b3e9-389d20408e92 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.188430 Sep 14 20:02:05.572564 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 445/880] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:05 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:05.652302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:05.656018 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:05.663323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:05.663910 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:05.664448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:05.665228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:05.665759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:05.666296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:05.703591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d10f2d89-0956-42da-8e73-2d0dc2cd96e5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055545 Sep 14 20:02:05.709615 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 436/881] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:02:05 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:06.599076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:06.600349 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:06.606739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:06.607228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:06.607662 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:06.608356 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:06.608808 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:06.609236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:06.625627 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:06.718482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:06.721856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:06.728451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:06.730252 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:06.730995 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:06.732645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:06.733621 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:06.734328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:06.734879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:06.751957 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:06.753920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:06.768599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:06.770127 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-23c713c4-c2f4-47bb-bc8b-11c9b9cef79b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056393 Sep 14 20:02:06.770696 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:06.771525 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 437/882] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:02:06 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 20:02:06.774281 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e70622bd-39dc-4172-9213-a1f9b5693c10 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.179244 Sep 14 20:02:06.775042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 446/883] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:06 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:06.842828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:06.843331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:06.850185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:06.850917 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:06.851555 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:06.853147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:06.853834 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:06.863310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:06.901671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:02:07.267472 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6828e618-11fe-408b-998a-8c43e5cbfb6b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 204 len: 0 microversion: 2.1 time: 0.428644 Sep 14 20:02:07.267990 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 438/884] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:02:06 2022] DELETE /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:02:07.276688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:07.277303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:07.283708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:07.284204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:07.284635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:07.285342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:07.285833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:07.286325 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:07.424468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:07.434914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0fd51b94-b71a-456b-a47b-76da673b99a7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1681 microversion: 2.1 time: 0.162241 Sep 14 20:02:07.435650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 447/885] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:07 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:07.805184 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:07.806033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:07.812713 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:07.813197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:07.813627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:07.814344 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:07.814795 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:07.815232 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:07.979996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:07.988069 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:07.989560 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:07.990757 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bb2f2b6e-8970-423f-b04f-75c53b25e2c2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.189951 Sep 14 20:02:07.991309 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 439/886] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:07 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:08.457835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:08.459588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:08.466757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:08.467491 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:08.468143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:08.469189 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:08.469895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:08.489206 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:08.658212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:08.668675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ee16ee7b-acb2-473c-959c-181d60f6a5f2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1681 microversion: 2.1 time: 0.214715 Sep 14 20:02:08.669886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 448/887] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:08 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:09.016188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:09.016941 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:09.023927 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:09.024668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:09.025106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:09.025824 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:09.026278 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:09.026705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:09.165295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:09.175679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:09.177270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:09.178597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7669f580-4d11-4b0e-b568-03ee9cde74f2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.166842 Sep 14 20:02:09.180272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 440/888] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:09 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:09.694701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:09.695983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:09.702916 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:09.703434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:09.703870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:09.704594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:09.705045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:09.705467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:09.870647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:09.911190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3f85cd59-8f7f-4284-b1e4-7236a57dc655 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1681 microversion: 2.1 time: 0.192513 Sep 14 20:02:09.911190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 449/889] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:09 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:10.205323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:10.206246 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:10.212819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:10.213521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:10.213996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:10.214687 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:10.215138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:10.215559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:10.354596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:10.364383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:10.365860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:10.367059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6da70e67-7a26-408d-97be-ff086bf2f230 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.166027 Sep 14 20:02:10.377993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 441/890] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:10 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:10.937820 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:10.938427 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:10.944794 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:10.945270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:10.945699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:10.946407 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:10.946849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:10.947266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:11.077280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:11.085834 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b0dd5bff-ddd6-45d8-a578-e220836070f5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1681 microversion: 2.1 time: 0.151883 Sep 14 20:02:11.086500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 450/891] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:10 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:11.393556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:11.394193 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:11.400478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:11.400945 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:11.401379 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:11.402140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:11.402601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:11.403024 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:11.546383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:11.554615 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:11.556056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:11.557457 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d32c350a-4267-4e07-8327-48d871f57aa3 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.167561 Sep 14 20:02:11.558264 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 442/892] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:11 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:12.112320 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:12.112922 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:12.120583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:12.121387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:12.122103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:12.122997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:12.123452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:12.123878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:12.583099 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:12.583978 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:12.590624 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:12.591654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:12.592097 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:12.592856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:12.593290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:12.593710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:12.630167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:12.639255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a77f1ce3-a5c2-4872-83fd-ed7c8ae9a6f0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1681 microversion: 2.1 time: 0.531150 Sep 14 20:02:12.656592 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 451/893] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:12 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1681 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:12.755433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:12.764219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:12.765676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:12.766877 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a7779bb0-1322-4b38-9ae8-c3c16f794860 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1741 microversion: 2.20 time: 0.187758 Sep 14 20:02:12.767430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 443/894] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:12 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:02:13.326557 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-79f733ca-4ee8-4d59-a4fa-a4c2cd3801cf req-8e0ea70a-d3f0-4b2e-b707-01b3a3207009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e", "name": "network-vif-deleted", "tag": "418e2560-6dba-4405-b1ca-657319b5665c"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:13.339890 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-79f733ca-4ee8-4d59-a4fa-a4c2cd3801cf req-8e0ea70a-d3f0-4b2e-b707-01b3a3207009 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:13.345475 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-79f733ca-4ee8-4d59-a4fa-a4c2cd3801cf req-8e0ea70a-d3f0-4b2e-b707-01b3a3207009 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:13.345475 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-79f733ca-4ee8-4d59-a4fa-a4c2cd3801cf req-8e0ea70a-d3f0-4b2e-b707-01b3a3207009 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:13.354343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-79f733ca-4ee8-4d59-a4fa-a4c2cd3801cf req-8e0ea70a-d3f0-4b2e-b707-01b3a3207009 service nova] Creating event network-vif-deleted:418e2560-6dba-4405-b1ca-657319b5665c for instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e on hv-cinder-83976 Sep 14 20:02:13.360375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-79f733ca-4ee8-4d59-a4fa-a4c2cd3801cf req-8e0ea70a-d3f0-4b2e-b707-01b3a3207009 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037687 Sep 14 20:02:13.361434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 452/895] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:13.667039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:13.668345 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:13.676354 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:13.677148 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:13.677785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:13.678540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:13.679165 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:13.679604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:13.714723 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:13.715226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:13.716669 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:13.717104 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:02:13.781354 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:13.793740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:13.795908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a46a1f62-10a4-4011-ad6b-9cb68325c766 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1330 microversion: 2.1 time: 0.132011 Sep 14 20:02:13.796060 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:13.796177 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 444/896] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:13 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1330 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:13.803735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:13.804217 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:13.804646 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:13.805344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:13.805816 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:13.806241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:14.014239 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:14.022661 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:14.024210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:14.025494 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1558cbe3-dad4-4c11-b5a9-a26079db41fe tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1723 microversion: 2.20 time: 0.236196 Sep 14 20:02:14.026129 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 453/897] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:13 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:14.818866 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:14.819482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:14.825912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:14.826415 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:14.826846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:14.827533 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:14.827990 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:14.828420 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:14.862474 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:14.862970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:14.863392 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:14.863844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:02:14.903738 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:14.911458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1414ba9e-42a8-4309-9ead-2a31c8df12da tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1330 microversion: 2.1 time: 0.096501 Sep 14 20:02:14.912013 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 445/898] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:14 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:15.051745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:15.052346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:15.058758 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:15.059240 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:15.060175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:15.060850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:15.061294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:15.061710 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:15.186200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:15.194124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:15.195544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:15.196670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6bdd119a-4efa-444e-b7b3-28c8d0ea1b35 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1723 microversion: 2.20 time: 0.148790 Sep 14 20:02:15.197213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 454/899] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:15 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:15.934884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:15.935490 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:15.941912 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:15.942386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:15.942814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:15.943489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:15.943935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:15.944354 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:15.974680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:15.975151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:15.975579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:15.976017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:02:16.015031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:16.022533 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-cf97d786-2ee5-4de9-ad3b-494f600e1445 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1330 microversion: 2.1 time: 0.091522 Sep 14 20:02:16.023088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 446/900] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:15 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1330 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:16.222777 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:16.223314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:16.229680 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:16.230216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:16.230651 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:16.231335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:16.231788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:16.232210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:16.361479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:16.369519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:16.370988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:16.372647 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-84352b97-3293-4b9c-95b6-c8aab4660cd4 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1723 microversion: 2.20 time: 0.153304 Sep 14 20:02:16.373197 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 455/901] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:16 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:17.046397 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:17.047012 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:17.053496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:17.054013 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:17.054452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:17.055145 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:17.055597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:17.056024 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:17.086599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:17.087077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:17.087546 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:17.087987 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:02:17.128144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:17.135785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1df803f9-b8b2-4fbc-9b48-11e9f806204f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 200 len: 1330 microversion: 2.1 time: 0.093863 Sep 14 20:02:17.136348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 447/902] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:17 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:17.398094 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:17.398654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:17.405493 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:17.405999 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:17.406588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:17.407170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:17.407614 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:17.408032 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:17.539455 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:17.548035 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:17.549507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:17.550734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b1b4c8cf-e664-4948-8428-1f7b937193d0 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1723 microversion: 2.20 time: 0.156541 Sep 14 20:02:17.551289 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 456/903] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:17 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:17.783900 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-5cca6d2b-d697-49f3-94cd-d23e446e8cce req-010b8476-f7f1-40cf-a569-9337409e4ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d406a90-e67e-4623-9697-11b9ed133316", "name": "network-vif-unplugged", "status": "completed", "tag": "25548a24-9696-4819-a2ea-b4a68fdf3d55"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:17.793368 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5cca6d2b-d697-49f3-94cd-d23e446e8cce req-010b8476-f7f1-40cf-a569-9337409e4ed9 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:17.793870 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5cca6d2b-d697-49f3-94cd-d23e446e8cce req-010b8476-f7f1-40cf-a569-9337409e4ed9 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:17.794304 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-5cca6d2b-d697-49f3-94cd-d23e446e8cce req-010b8476-f7f1-40cf-a569-9337409e4ed9 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:17.805130 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-5cca6d2b-d697-49f3-94cd-d23e446e8cce req-010b8476-f7f1-40cf-a569-9337409e4ed9 service nova] Creating event network-vif-unplugged:25548a24-9696-4819-a2ea-b4a68fdf3d55 for instance 2d406a90-e67e-4623-9697-11b9ed133316 on hv-cinder-83976 Sep 14 20:02:17.810048 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-5cca6d2b-d697-49f3-94cd-d23e446e8cce req-010b8476-f7f1-40cf-a569-9337409e4ed9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029851 Sep 14 20:02:17.810631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 448/904] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:02:18.158261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:18.158873 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:18.164711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:18.165196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:18.165633 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:18.166343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:18.166797 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:18.167222 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:18.180193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e HTTP/1.1 Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:02:18.181827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:02:18.183472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e'} Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:02:18.184984 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:02:18.186593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:02:18.187940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:02:18.187940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cb4b3fcc-e84d-4525-9742-1bfef7e5aeae tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 404 len: 111 microversion: 2.1 time: 0.028796 Sep 14 20:02:18.187940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 457/905] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:18 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 20:02:18.194143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e4282bf3-b8c8-4793-98da-516dcc85553d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '.version_select at 0x7f19e5693700>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:18.296975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e4282bf3-b8c8-4793-98da-516dcc85553d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-357598214" status: 202 len: 0 microversion: 2.1 time: 0.107443 Sep 14 20:02:18.297529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 449/906] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 20:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-357598214 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:02:18.576526 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:18.577140 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:18.585228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:18.586089 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:18.586544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:18.587241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:18.587688 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:18.588109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:18.813195 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:18.822372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:18.824051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:18.825543 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4d73b0eb-5cce-48f7-913a-a8b93ebb397e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1726 microversion: 2.20 time: 0.252882 Sep 14 20:02:18.826124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 458/907] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:18 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1726 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:18.851774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27948974-aede-412d-9ae7-67e1c1adf625"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:18.854434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:18.864539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:18.865034 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:18.865527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:18.866181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:18.866633 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:18.867052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:19.184704 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ba632f5c-f5ab-4262-913f-2d058ba033d0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: .version_select at 0x7f19e8e6c040>, body: {"keypair": {"name": "tempest-keypair-860888469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdMsS49JHRx7F8Om7meJDw3ZDaZCaFyl/thDe9lsYyafc/fjTngk0CFz23scRoNa5+KbX1DQkxWwVLTVyl7gDqCv2w/g+pELVLEX+pH/LhIcHK4c4UE4qjPCl6SFfyF6A=="}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:19.200760 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-ba632f5c-f5ab-4262-913f-2d058ba033d0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:02:19.204609 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-ba632f5c-f5ab-4262-913f-2d058ba033d0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'key_pairs'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:02:19.314248 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ba632f5c-f5ab-4262-913f-2d058ba033d0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133314 Sep 14 20:02:19.314915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 459/908] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 20:02:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:02:19.962427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:20.055480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-35a6f215-c38d-4ad6-89a5-65adf64b0741 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.207638 Sep 14 20:02:20.056227 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 450/909] 10.222.0.42 () {62 vars in 1364 bytes} [Wed Sep 14 20:02:18 2022] POST /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-volume_attachments => generated 188 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 20:02:20.190083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:20.190589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:20.196598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:20.197303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:20.197940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:20.198816 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:20.199690 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:20.200873 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:20.855441 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3631ffb7-5eb9-4d1b-aa3c-4651ca2e5f2e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-volume_attachments/27948974-aede-412d-9ae7-67e1c1adf625" status: 202 len: 0 microversion: 2.20 time: 0.669710 Sep 14 20:02:20.856918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 460/910] 10.222.0.42 () {60 vars in 1457 bytes} [Wed Sep 14 20:02:20 2022] DELETE /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-volume_attachments/27948974-aede-412d-9ae7-67e1c1adf625 => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:02:20.924625 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:20.925225 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:20.933190 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:20.938865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:20.938865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:20.938865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:20.938865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:20.939201 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:20.966872 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132862) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 20:02:21.274683 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-629a1d1a-f31e-40f7-9333-bc1ee9074937 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "POST /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/action" status: 202 len: 0 microversion: 2.20 time: 0.354642 Sep 14 20:02:21.275296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 451/911] 10.222.0.42 () {62 vars in 1319 bytes} [Wed Sep 14 20:02:20 2022] POST /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:02:21.284316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:21.284949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:21.291889 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:21.292367 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:21.292798 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:21.293753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:21.294246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:21.294643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:21.496801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:21.504891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:21.506355 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:21.507504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8dcb990e-8851-4879-ac44-7c5e20efd721 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1674 microversion: 2.20 time: 0.227357 Sep 14 20:02:21.508052 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 461/912] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:21 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:21.892383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1095302530", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fdcbc0df-73f5-4094-bf95-288827ed92e6"}], "security_groups": [{"name": "tempest-securitygroup--875378113"}], "key_name": "tempest-keypair-860888469", "user_data": "}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:22.000832 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] validate_networks() for [('fdcbc0df-73f5-4094-bf95-288827ed92e6', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:02:22.365058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:02:22.365486 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:02:22.366008 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:02:22.366425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:02:22.366841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:02:22.375648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:22.376130 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:22.376575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:22.377300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:22.377761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:22.378281 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:22.396823 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:02:22.400868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Getting quotas for user be0920bd9b934f039e5e4de8039346b8 and project 5d8e3f408bde455b86274e11fa626eb4. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:02:22.412210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:02:22.414545 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:02:22.526196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a7e399ef-9831-40b2-99ee-3f507d83e60b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.638659 Sep 14 20:02:22.527247 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 452/913] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:02:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:02:22.533637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:22.534434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:22.538574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a6e9d2bc-82c6-4bcf-8983-1a099bd3e12c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:22.539192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a6e9d2bc-82c6-4bcf-8983-1a099bd3e12c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:22.541063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:22.541544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:22.542174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:22.542747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:22.543196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:22.543611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:22.601972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a6e9d2bc-82c6-4bcf-8983-1a099bd3e12c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:22.609597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a6e9d2bc-82c6-4bcf-8983-1a099bd3e12c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1241 microversion: 2.1 time: 0.075059 Sep 14 20:02:22.620437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 453/914] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:22 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:22.688783 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:22.692720 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:22.698249 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:22.699668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:22.701339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-01fa595e-8c65-4b10-872e-0000218a58e5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1674 microversion: 2.20 time: 0.171528 Sep 14 20:02:22.702096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 462/915] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:22 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:02:23.631458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:23.632074 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:23.638611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:23.639098 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:23.639532 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:23.640219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:23.640698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:23.641125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:23.708519 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:23.716524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2ff20982-e3e5-445e-97ac-d6f74f48b03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1245 microversion: 2.1 time: 0.088932 Sep 14 20:02:23.717099 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 454/916] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:23 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:23.727940 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:23.733101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:23.733101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:23.736848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:23.737326 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:23.737757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:23.738536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:23.739211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:23.739429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:24.033023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:24.042697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:24.045539 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:24.047574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3393c1c2-18e5-4017-9d5c-d68044e6513f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1674 microversion: 2.20 time: 0.323921 Sep 14 20:02:24.048122 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 463/917] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:23 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:24.743406 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:24.744017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:24.751027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:24.751458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:24.751907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:24.752581 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:24.753033 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:24.753458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:24.818166 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:24.826686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7bd5401b-5144-44e9-a1fb-1def56f71381 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1237 microversion: 2.1 time: 0.086371 Sep 14 20:02:24.827530 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 455/918] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:24 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:25.072881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:25.074924 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:25.082303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:25.082982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:25.083501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:25.084504 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:25.085149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:25.085757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:25.274405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:25.282411 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:25.283829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:25.284963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f2183953-3179-47b8-b8d4-ded0296d7f5c tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.216322 Sep 14 20:02:25.285499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 464/919] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:25 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:25.850873 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:25.854564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:25.857960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:25.858448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:25.858881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:25.859755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:25.860197 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:25.860815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:25.924961 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:25.932698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-537d55d6-30dd-493c-8876-527de040964f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1301 microversion: 2.1 time: 0.085737 Sep 14 20:02:25.933466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 456/920] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:25 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:26.312272 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:26.313750 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:26.321110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:26.321958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:26.322591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:26.323694 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:26.324622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:26.325264 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:26.804786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:26.825252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:26.828490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:26.828490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4ffdb810-848d-43a0-85a0-dbaa858165c7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.520427 Sep 14 20:02:26.842219 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 465/921] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:26 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:26.959830 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:26.961295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:26.969936 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:26.970431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:26.971158 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:26.971865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:26.972322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:26.972748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:27.041109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:27.049145 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bb3f7b4f-2341-421a-8ac0-b802956c75ef tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1299 microversion: 2.1 time: 0.093917 Sep 14 20:02:27.051451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 457/922] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:26 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:27.854593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:27.855328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:27.863401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:27.863886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:27.864317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:27.865018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:27.865492 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:27.865971 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:28.006401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:28.016304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:28.017757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:28.019109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c2227796-6f09-4d94-9bf7-2300329dc0ff tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.168347 Sep 14 20:02:28.020022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 466/923] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:27 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:28.076795 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:28.077469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:28.084290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:28.084787 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:28.085227 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:28.085955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:28.086417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:28.086845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:28.223757 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:28.232407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a807c3c8-8f0f-4ef8-853a-8c185e1f72a0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.159898 Sep 14 20:02:28.233113 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 458/924] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:28 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:29.046468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:29.047191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:29.054274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:29.054753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:29.055180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:29.056063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:29.056512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:29.056933 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:29.202376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:29.211005 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:29.212433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:29.213621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5357172a-a66f-4763-a4c9-2db43f16dcd5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.171741 Sep 14 20:02:29.214210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 467/925] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:29 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:29.255829 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:29.256380 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:29.257577 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:29.258364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:29.260263 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:29.265929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:29.266683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:29.267112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:29.267980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:29.268579 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:29.269169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:29.269951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:29.279594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:29.279594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:29.279594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:29.279594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:29.280036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:29.304933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a1723ada-8e50-4bbe-a462-297c617a2520 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/ips" status: 200 len: 146 microversion: 2.1 time: 0.052917 Sep 14 20:02:29.314191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 459/926] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 20:02:29 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:29.430588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:29.438235 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9a2a2f64-ce1a-4499-bce2-3ccd99f8f06c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.184883 Sep 14 20:02:29.438788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 468/927] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:29 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:30.242403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:30.243010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:30.252310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:30.253040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:30.253689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:30.254780 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:30.255433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:30.256054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:30.412235 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:30.420815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:30.422291 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:30.423449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-76f2628e-d570-4687-b5eb-acd5198852fc tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.185362 Sep 14 20:02:30.424001 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 460/928] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:30 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:30.461908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:30.462457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:30.469244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:30.469725 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:30.470184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:30.470926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:30.471385 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:30.471811 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:30.676002 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:30.683999 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2e73e0ab-7799-4c4f-ad64-91dfca2b9601 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.226245 Sep 14 20:02:30.699524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 469/929] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:30 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:30.991238 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cab89ffd-547a-456c-a897-91e600d0cd53"}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:30.993647 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:30.999657 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:31.000141 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:31.000575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:31.001263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:31.001753 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:31.002209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:31.449135 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:31.449869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:31.456424 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:31.456926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:31.457344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:31.458055 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:31.458532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:31.459203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:31.610147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:31.619221 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:31.620669 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:31.621920 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-428a2379-f5cd-44ef-9786-62200a901262 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.176687 Sep 14 20:02:31.623233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 470/930] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:31 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:02:31.721266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:31.722029 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:31.733836 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:31.734342 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:31.734784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:31.735490 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:31.735951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:31.736382 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:31.917413 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:31.928817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5c5da8f6-2597-481e-878a-d09a80add604 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.211769 Sep 14 20:02:31.930062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 471/931] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:31 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:32.386580 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:32.607730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=8 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:32.648338 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:32.649894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:32.659124 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:32.659644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:32.667457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:32.667457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:32.667457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:32.667457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:32.834597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:32.843675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:32.845431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:32.846412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-162cfcea-44b8-4609-af16-e1536af0bf8f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.201996 Sep 14 20:02:32.846997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 472/932] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:32 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:02:32.954473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:32.955012 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:32.961424 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:32.962069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:32.962524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:32.963206 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:32.963654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:32.964072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:33.106174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:33.114311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-532c8324-466c-4c33-a98c-cc0b6e5a17ed tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.164330 Sep 14 20:02:33.115282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 473/933] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:32 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:33.881236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:33.882799 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:33.890339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:33.891145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:33.891818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:33.892858 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:33.893323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:33.893749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:34.046092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:34.054731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:34.056167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:34.068832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-60b5f866-3dfa-4c67-ad50-09355df3743f tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.194946 Sep 14 20:02:34.069540 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 474/934] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:33 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:34.144407 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:34.145240 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:34.151262 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:34.151824 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:34.152337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:34.153118 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:34.153644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:34.154729 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:34.325532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:34.336126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ff94ac87-199b-4c94-8c59-a036b8b93993 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.195490 Sep 14 20:02:34.353080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 475/935] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:34 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:35.100588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:35.101244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:35.108168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:35.108670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:35.109071 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:35.109766 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:35.110245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:35.110670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:35.266640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:35.270059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:35.271583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:35.272728 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-89f6e156-73d4-4c86-8d68-fbc1f9737254 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.176164 Sep 14 20:02:35.273276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 476/936] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:35 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:02:35.361362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:35.361917 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:35.369753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:35.370403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:35.370988 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:35.371883 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:35.372425 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:35.373723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:35.525685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:35.533759 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9a0f87c8-8424-4078-8446-03763e40d5c9 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.176977 Sep 14 20:02:35.538828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 477/937] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:35 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:36.302388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:36.303062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:36.309747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:36.310630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:36.311061 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:36.311756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:36.312261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:36.312622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:36.482970 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:36.492832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:36.494528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:36.495786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4bb5b332-e0f0-4d70-8301-d1ef4697093a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.197468 Sep 14 20:02:36.496337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 478/938] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:36 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:02:36.556856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:36.558978 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:36.564275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:36.564773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:36.565206 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:36.565929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:36.566384 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:36.566810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:36.585454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=100 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:36.708319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:36.717190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c459dd1d-f1c3-46ab-bd3c-fecf0ea86125 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.164299 Sep 14 20:02:36.717889 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 479/939] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:36 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:37.522952 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:37.523595 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:37.530372 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:37.530854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:37.531290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:37.531982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:37.532436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:37.532861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:37.660967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:37.668937 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:37.671065 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:37.672225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7a12ec79-e8d4-4012-a26f-25f6498ca0f5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.153153 Sep 14 20:02:37.672772 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 480/940] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:37 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 20:02:37.740054 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:37.740635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:37.747111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:37.747599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:37.748028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:37.748714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:37.749163 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:37.749885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:37.947569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:37.956211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-98dad439-ff59-4544-9c2b-9b311aa27097 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.219872 Sep 14 20:02:37.963485 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 481/941] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:37 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:38.175837 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-49eeb47d-d060-4e15-8ac8-eaa00a40f989 req-f2085a97-a433-471a-89d1-2076d250913b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c0ade0-a9e0-476e-a02a-9255d28776d3", "tag": "7ac88e64-0677-4a93-a678-ff412ef102b6"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:38.186158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-49eeb47d-d060-4e15-8ac8-eaa00a40f989 req-f2085a97-a433-471a-89d1-2076d250913b service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:38.186635 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-49eeb47d-d060-4e15-8ac8-eaa00a40f989 req-f2085a97-a433-471a-89d1-2076d250913b service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:38.187064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-49eeb47d-d060-4e15-8ac8-eaa00a40f989 req-f2085a97-a433-471a-89d1-2076d250913b service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:38.198138 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-49eeb47d-d060-4e15-8ac8-eaa00a40f989 req-f2085a97-a433-471a-89d1-2076d250913b service nova] Creating event network-changed:7ac88e64-0677-4a93-a678-ff412ef102b6 for instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 on hv-cinder-83976 Sep 14 20:02:38.203758 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-49eeb47d-d060-4e15-8ac8-eaa00a40f989 req-f2085a97-a433-471a-89d1-2076d250913b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Sep 14 20:02:38.204351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 482/942] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:02:38.425669 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d2191837-1957-4caf-beca-0e7526e74bab tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.438375 Sep 14 20:02:38.426351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 461/943] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 20:02:30 2022] POST /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments => generated 194 bytes in 7440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:38.698881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:38.699575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:38.705780 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:38.706330 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:38.706768 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:38.707462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:38.707915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:38.708340 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:38.925548 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:38.933640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:38.935129 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:38.936275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-78661eae-269c-4ce9-99e6-43d015e31cee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.242254 Sep 14 20:02:38.936823 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 483/944] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:38 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:38.981100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:38.981878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:38.985202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:38.990510 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:38.990933 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:38.991374 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:38.992110 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:38.992576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:38.993006 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:39.122838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:39.131348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-499152d5-7a6d-40ec-bc75-70744956c03d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.155039 Sep 14 20:02:39.132091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 462/945] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:38 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:39.961483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:39.962160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:39.968658 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:39.969143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:39.969576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:39.970281 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:39.970733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:39.971156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:40.153790 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:40.155050 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:40.156266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:40.162335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:40.163209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:40.163707 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:40.163829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:40.164144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:40.164847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:40.164953 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cd88dc30-7cbc-4e64-9bb3-4e4feee5e26a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.207660 Sep 14 20:02:40.165300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:40.165652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 484/946] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:39 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:40.167187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:40.298128 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:40.306025 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a6364473-edbb-4f88-bb05-17182075ca04 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.155503 Sep 14 20:02:40.306593 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 463/947] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:40 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:41.196070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:41.196598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:41.203691 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:41.204166 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:41.204597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:41.205275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:41.205723 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:41.206210 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:41.330336 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:41.331100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:41.332322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:41.338077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:41.338574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:41.339036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:41.339884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:41.340346 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:41.340779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:41.340975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:41.342472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:41.344201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-6c998c46-a737-4bc8-9bb4-38857a035e3e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.151512 Sep 14 20:02:41.344771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 485/948] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:41 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:41.471576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:41.479167 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6323db40-8347-40a6-af20-4fa40dfd42d4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.153439 Sep 14 20:02:41.479724 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 464/949] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:41 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:42.369518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:42.370203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:42.376701 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:42.377183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:42.377623 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:42.378343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:42.378802 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:42.379272 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:42.502077 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:42.502856 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:42.509410 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:42.509886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:42.511599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:42.511599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:42.511599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:42.511599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:42.512013 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:42.518757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:42.520200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:42.521369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-13c8faee-968a-47cb-961f-81b738c9ede9 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.155821 Sep 14 20:02:42.522030 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 486/950] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:42 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:42.640302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:42.647889 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-79f0a863-60fc-4bfc-8acf-617bfcbdc8fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.149913 Sep 14 20:02:42.648448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 465/951] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:42 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:43.547733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:43.548343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:43.554835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:43.555153 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:43.555567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:43.556251 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:43.556699 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:43.557126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:43.671380 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:43.672012 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:43.678589 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:43.679129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:43.679568 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:43.680258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:43.680709 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:43.681178 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:43.694308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:43.699860 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:43.703102 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:43.704563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:43.705722 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-28e9028b-4924-4d8a-9516-be761705709e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.162644 Sep 14 20:02:43.706318 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 487/952] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:43 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:43.816374 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:43.823873 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-aabf2eea-f1f2-4c59-bbe4-328117d0f6d7 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.157032 Sep 14 20:02:43.824436 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 466/953] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:43 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:44.298872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-38a514a1-2b68-4ae6-ac70-a30e975ddb9e req-ec8cfc55-b82d-4e8a-9af8-4660851806e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d406a90-e67e-4623-9697-11b9ed133316", "name": "network-vif-plugged", "status": "completed", "tag": "25548a24-9696-4819-a2ea-b4a68fdf3d55"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:44.308174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-38a514a1-2b68-4ae6-ac70-a30e975ddb9e req-ec8cfc55-b82d-4e8a-9af8-4660851806e3 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:44.308645 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-38a514a1-2b68-4ae6-ac70-a30e975ddb9e req-ec8cfc55-b82d-4e8a-9af8-4660851806e3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:44.309068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-38a514a1-2b68-4ae6-ac70-a30e975ddb9e req-ec8cfc55-b82d-4e8a-9af8-4660851806e3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:44.320636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-38a514a1-2b68-4ae6-ac70-a30e975ddb9e req-ec8cfc55-b82d-4e8a-9af8-4660851806e3 service nova] Creating event network-vif-plugged:25548a24-9696-4819-a2ea-b4a68fdf3d55 for instance 2d406a90-e67e-4623-9697-11b9ed133316 on hv-cinder-83976 Sep 14 20:02:44.326350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-38a514a1-2b68-4ae6-ac70-a30e975ddb9e req-ec8cfc55-b82d-4e8a-9af8-4660851806e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Sep 14 20:02:44.327168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 488/954] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:44.734987 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:44.735795 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:44.743381 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:44.744118 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:44.744892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:44.745820 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:44.746443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:44.747037 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:44.849852 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:44.850555 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:44.866385 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:44.884958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:44.884958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:44.884958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:44.884958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:44.886019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:44.936583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:44.947255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:44.949170 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:44.951308 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-aa309f78-10df-4423-b852-62ddc573d549 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.222265 Sep 14 20:02:44.952565 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 467/955] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:44 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:45.030508 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:45.038225 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1a1a6a86-a5e7-43ff-aab0-83da38606a05 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.194261 Sep 14 20:02:45.040807 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 489/956] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:44 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:45.978702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:45.979349 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:45.985627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:45.986143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:45.986576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:45.987260 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:45.987717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:45.988126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:46.061610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:46.063000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:46.069711 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:46.070229 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:46.070710 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:46.071403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:46.071878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:46.072271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:46.123490 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:46.131739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:46.133121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:46.134350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-27208d0a-a639-41ab-aea9-24c8e4eb953e tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.159523 Sep 14 20:02:46.134905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 468/957] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:45 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:46.206431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:46.214246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-54b5b9ca-28cb-4c2b-8edc-b5878bdf78a1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.156583 Sep 14 20:02:46.214813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 490/958] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:46 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:46.340492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-dcd801bb-15b7-4f81-9503-d34a4f00ace3 req-c42d1644-ab94-4ee2-881c-f155a09c6c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c0ade0-a9e0-476e-a02a-9255d28776d3", "name": "network-vif-plugged", "status": "completed", "tag": "7ac88e64-0677-4a93-a678-ff412ef102b6"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:46.351244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-dcd801bb-15b7-4f81-9503-d34a4f00ace3 req-c42d1644-ab94-4ee2-881c-f155a09c6c17 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:46.351756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-dcd801bb-15b7-4f81-9503-d34a4f00ace3 req-c42d1644-ab94-4ee2-881c-f155a09c6c17 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:46.356678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-dcd801bb-15b7-4f81-9503-d34a4f00ace3 req-c42d1644-ab94-4ee2-881c-f155a09c6c17 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:46.363265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-dcd801bb-15b7-4f81-9503-d34a4f00ace3 req-c42d1644-ab94-4ee2-881c-f155a09c6c17 service nova] Creating event network-vif-plugged:7ac88e64-0677-4a93-a678-ff412ef102b6 for instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 on hv-cinder-83976 Sep 14 20:02:46.367841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-dcd801bb-15b7-4f81-9503-d34a4f00ace3 req-c42d1644-ab94-4ee2-881c-f155a09c6c17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031151 Sep 14 20:02:46.368517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 469/959] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:47.160574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:47.161175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:47.175401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:47.175401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:47.175401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:47.175401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:47.175861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:47.175861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:47.240702 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:47.241500 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:47.249356 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:47.250091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:47.255698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:47.255698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:47.255698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:47.255698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:47.311731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:47.322739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:47.326697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:47.328765 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c0147de7-75ca-4c8a-bfdf-e50d385851d6 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.171671 Sep 14 20:02:47.329863 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 491/960] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:47 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:47.410655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:47.418223 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b91a5500-0111-4137-abdf-24d9cba6b7f1 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.183396 Sep 14 20:02:47.418783 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 470/961] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:47 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:02:48.359057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:48.359607 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:48.366093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:48.366580 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:48.367018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:48.367761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:48.368403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:48.368835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:48.441589 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:48.442280 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:48.448904 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:48.449394 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:48.449868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:48.450573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:48.451026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:48.451489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:48.549664 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:48.558538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:48.563931 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:48.563931 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ec74732e-488a-4ad4-a8c1-19c9d20a4398 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1732 microversion: 2.20 time: 0.206486 Sep 14 20:02:48.563931 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 492/962] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:48 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:48.589223 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:48.598557 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fdd98ef0-d03a-4b3a-b899-2b312dad0a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1366 microversion: 2.1 time: 0.160975 Sep 14 20:02:48.599144 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 471/963] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:48 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:49.587042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:49.587659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:49.594742 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:49.595414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:49.595918 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:49.596596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:49.597043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:49.597470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:49.622644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:49.623360 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:49.631900 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:49.632472 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:49.632985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:49.633755 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:49.634316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:49.634845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:49.748096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:49.757275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:49.769522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:49.769522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-940b27fa-4c58-4ef6-8322-af33c65b594d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1719 microversion: 2.20 time: 0.177102 Sep 14 20:02:49.769522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 493/964] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:02:49 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:02:49.774489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:02:49.782862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-43d3cf6f-2d12-4b61-9a0e-f2ab03eddef5 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1556 microversion: 2.1 time: 0.164969 Sep 14 20:02:49.783423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 472/965] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:02:49 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:02:49.817382 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:49.818333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:49.824513 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:49.825006 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:49.825512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:49.826246 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:49.826707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:49.827678 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:49.919022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-93fe8cde-8911-4296-aed7-d9293e41ceb4 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106239 Sep 14 20:02:49.927713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 494/966] 10.222.0.42 () {58 vars in 1275 bytes} [Wed Sep 14 20:02:49 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:50.255465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:50.257792 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:50.264096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:50.264777 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:50.265226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:50.265963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:50.266592 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:50.267023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:50.298453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9dcd1e2b-8d21-44f0-aa95-01a36fd324f4 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046873 Sep 14 20:02:50.299070 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 473/967] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:02:50 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:50.310359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:02:50.311142 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:50.317698 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:50.318495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:50.318967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:50.319684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:50.320143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:50.320566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:50.354439 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f91a80c3-da6e-49c0-830e-1659320462c0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/cab89ffd-547a-456c-a897-91e600d0cd53" status: 200 len: 194 microversion: 2.1 time: 0.048211 Sep 14 20:02:50.360965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 495/968] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Sep 14 20:02:50 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/cab89ffd-547a-456c-a897-91e600d0cd53 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:51.214542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-4c1c4327-afbb-454e-9631-52b5e3496962 req-bd4d2ca5-97e6-499c-ba66-3c0089e16764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c0ade0-a9e0-476e-a02a-9255d28776d3", "tag": "7ac88e64-0677-4a93-a678-ff412ef102b6"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:51.224429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4c1c4327-afbb-454e-9631-52b5e3496962 req-bd4d2ca5-97e6-499c-ba66-3c0089e16764 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:51.224907 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4c1c4327-afbb-454e-9631-52b5e3496962 req-bd4d2ca5-97e6-499c-ba66-3c0089e16764 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:51.225335 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-4c1c4327-afbb-454e-9631-52b5e3496962 req-bd4d2ca5-97e6-499c-ba66-3c0089e16764 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:51.239132 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-4c1c4327-afbb-454e-9631-52b5e3496962 req-bd4d2ca5-97e6-499c-ba66-3c0089e16764 service nova] Creating event network-changed:7ac88e64-0677-4a93-a678-ff412ef102b6 for instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 on hv-cinder-83976 Sep 14 20:02:51.244072 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-4c1c4327-afbb-454e-9631-52b5e3496962 req-bd4d2ca5-97e6-499c-ba66-3c0089e16764 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033622 Sep 14 20:02:51.247139 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 474/969] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:02:52.030809 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "478d8a64-4d5f-440f-a450-c3d278ee95a9"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:02:52.033324 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:02:52.039570 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:52.040053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:52.040488 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:52.041183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:02:52.041636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:02:52.042289 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:02:52.771345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:02:52.969148 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cc8b4eea-2142-4c84-bd78-b5a9919fc9bc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "POST /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942387 Sep 14 20:02:52.969691 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 496/970] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 20:02:52 2022] POST /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:01.559504 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=25 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:01.560427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=42 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:01.565086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:01.567502 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:01.573529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:01.574061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:01.574494 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:01.575211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:01.575685 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:01.576109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:01.607555 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c5fed112-9d2b-416e-bb73-cde31be2b956 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049608 Sep 14 20:03:01.608573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 475/971] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:03:01 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:01.758175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:01.758788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:01.761027 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=68 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:01.766926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:01.767423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:01.767856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:01.768551 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:01.769003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:01.769428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:01.801108 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d953f10f-41dc-488a-b4ed-ce791fdb19f7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/cab89ffd-547a-456c-a897-91e600d0cd53" status: 200 len: 194 microversion: 2.1 time: 0.048047 Sep 14 20:03:01.807297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 497/972] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Sep 14 20:03:01 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/cab89ffd-547a-456c-a897-91e600d0cd53 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:01.813185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:01.813662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:01.820478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:01.820970 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:01.821406 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:01.822131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:01.822584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:01.823011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:01.904036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'services' on Instance uuid 8067613a-f4df-44e1-9aa6-b6d7a39a119c {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:03:02.198236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2ddaf363-88fa-40be-84f7-e230cafca3d7 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/cab89ffd-547a-456c-a897-91e600d0cd53" status: 202 len: 0 microversion: 2.1 time: 0.389675 Sep 14 20:03:02.198839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 476/973] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:03:01 2022] DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/cab89ffd-547a-456c-a897-91e600d0cd53 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:03:04.377671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:04.378233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:04.384869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:04.385343 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:04.385773 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:04.386469 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:04.386915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:04.387333 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:04.417611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2ed662b0-6ff7-42b6-919e-c8bd544b0351 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/478d8a64-4d5f-440f-a450-c3d278ee95a9" status: 200 len: 194 microversion: 2.1 time: 0.044608 Sep 14 20:03:04.418211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 498/974] 10.222.0.42 () {58 vars in 1413 bytes} [Wed Sep 14 20:03:04 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/478d8a64-4d5f-440f-a450-c3d278ee95a9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:04.430207 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:04.430828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:04.437418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:04.437934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:04.438371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:04.439055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:04.439510 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:04.439937 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:04.520996 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'services' on Instance uuid 8067613a-f4df-44e1-9aa6-b6d7a39a119c {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:03:04.782012 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c7fd4457-097c-47ae-a1e4-7349a2833200 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/478d8a64-4d5f-440f-a450-c3d278ee95a9" status: 202 len: 0 microversion: 2.1 time: 0.356074 Sep 14 20:03:04.782728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 477/975] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:03:04 2022] DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments/478d8a64-4d5f-440f-a450-c3d278ee95a9 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:03:05.962147 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:05.964390 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:05.971186 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:05.971659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:05.972087 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:05.972849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:05.973299 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:05.973713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:06.002241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2592ed05-0ef2-49d4-8151-4f51f69007bb tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044302 Sep 14 20:03:06.002801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 499/976] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:03:05 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 20:03:06.118397 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:06.120836 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:06.126974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:06.127455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:06.127888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:06.128575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:06.129052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:06.129476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:06.159320 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c16a5052-297f-4c34-bd80-5f28b7dc7c24 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045751 Sep 14 20:03:06.159870 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 478/977] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:03:06 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 20:03:06.225975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:06.226468 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:06.232401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:06.232871 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:06.233298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:06.233998 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:06.234445 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:06.234861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:06.260410 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Going to try to terminate instance {{(pid=132861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:03:06.565430 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b331acc5-e711-4b96-9af9-163ca5627987 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 204 len: 0 microversion: 2.1 time: 0.343036 Sep 14 20:03:06.566133 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 500/978] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:03:06 2022] DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:03:06.574839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:06.575643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:06.582620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:06.583102 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:06.583537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:06.584411 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:06.584859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:06.585534 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:06.717227 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:06.725645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ab364eab-0614-4ca3-a7be-3616b87a36fc tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1672 microversion: 2.1 time: 0.155095 Sep 14 20:03:06.728960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 479/979] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:06 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:07.749548 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:07.750335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:07.756880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:07.757365 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:07.757849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:07.758547 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:07.759003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:07.759429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:07.891007 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:07.898767 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e6adf1b6-225d-417b-852c-40779c806bc1 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1672 microversion: 2.1 time: 0.153430 Sep 14 20:03:07.899324 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 501/980] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:07 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:08.922716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:08.923382 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:08.929435 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:08.929950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:08.930387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:08.931072 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:08.931525 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:08.931947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:09.059488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:09.067831 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-79a1dcbf-2caa-458e-91ba-6ca8420974e0 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1672 microversion: 2.1 time: 0.149202 Sep 14 20:03:09.068427 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 480/981] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:08 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:09.368601 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-4e067059-8686-4b0c-82a7-d0cf2518c2da req-f181f891-62fe-462d-9336-63407f3c26ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8067613a-f4df-44e1-9aa6-b6d7a39a119c", "name": "network-vif-deleted", "tag": "4029e4db-b1ef-4868-b253-8130c5772587"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:03:09.380919 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4e067059-8686-4b0c-82a7-d0cf2518c2da req-f181f891-62fe-462d-9336-63407f3c26ed service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:09.381460 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4e067059-8686-4b0c-82a7-d0cf2518c2da req-f181f891-62fe-462d-9336-63407f3c26ed service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:09.382010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4e067059-8686-4b0c-82a7-d0cf2518c2da req-f181f891-62fe-462d-9336-63407f3c26ed service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:09.393509 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-4e067059-8686-4b0c-82a7-d0cf2518c2da req-f181f891-62fe-462d-9336-63407f3c26ed service nova] Creating event network-vif-deleted:4029e4db-b1ef-4868-b253-8130c5772587 for instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c on hv-cinder-83976 Sep 14 20:03:09.398479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-4e067059-8686-4b0c-82a7-d0cf2518c2da req-f181f891-62fe-462d-9336-63407f3c26ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033888 Sep 14 20:03:09.399339 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 502/982] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:10.091708 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:10.092407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:10.099676 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:10.100263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:10.100654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:10.101348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:10.101815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:10.102245 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:10.165181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:10.172950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-9012c8c2-9877-48bf-b6e4-62c48eaacda5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1604 microversion: 2.1 time: 0.085134 Sep 14 20:03:10.173507 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 481/983] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:10 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1604 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:11.195854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:11.196483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:11.203228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:11.203714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:11.204158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:11.204849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:11.205307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:11.205742 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:11.270174 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:11.277983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4e4e925d-db71-4382-965c-617d93ecc80c tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1320 microversion: 2.1 time: 0.086411 Sep 14 20:03:11.278541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 503/984] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:11 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1320 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:12.301284 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:12.301949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:12.308494 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:12.308971 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:12.309403 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:12.310174 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:12.310672 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:12.311093 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:12.346816 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:12.347323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:12.347876 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:12.348323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lazy-loading 'fault' on Instance uuid 8067613a-f4df-44e1-9aa6-b6d7a39a119c {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:03:12.392821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268dbf54f29c40d9a4daa772c44735d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e52433815b1440de8bfe05dc7d14b7f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:12.400251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f20a6fe7-e87e-40b6-b668-7eee4d8d1d12 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 200 len: 1325 microversion: 2.1 time: 0.102811 Sep 14 20:03:12.400881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 482/985] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:12 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 1325 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:13.423483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:13.424106 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:13.430611 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:13.431093 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:13.431521 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:13.432201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:13.432650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:13.433070 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:13.446452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] HTTP exception thrown: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Request method failure captured: Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c HTTP/1.1 Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHGiilxWoD4FTg9nekXuBhW1-7liAs-hfyDuo2saLPSKMBQunBkGnoiANwd7QUiqXFLNRgqdsGlc5W37RRTFv6syCzGol-rwwx3RzQOSDdEigbwbiWHwuY6Z4ZFz85JOIhbNV5oJBgGAjdh_5nnN0Cy5uIQztxTwoa12hPNcF6c5Sw Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:13.448072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e52433815b1440de8bfe05dc7d14b7f5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}] Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 268dbf54f29c40d9a4daa772c44735d4 Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:13.449730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '8067613a-f4df-44e1-9aa6-b6d7a39a119c'} Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:13.450885 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:13.452552 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:13.454091 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Returning 404 to user: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:13.454091 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cf686c30-2642-479c-ad92-41965bf3c976 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 404 len: 111 microversion: 2.1 time: 0.029784 Sep 14 20:03:13.454091 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 504/986] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:13 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:13.459018 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8621f92e-5cb5-440e-a7b6-c6ccd6f7f4a8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '.version_select at 0x7f19e596eee0>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:13.520340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8621f92e-5cb5-440e-a7b6-c6ccd6f7f4a8 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51860525" status: 202 len: 0 microversion: 2.1 time: 0.065842 Sep 14 20:03:13.520935 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 483/987] 10.222.0.42 () {58 vars in 1215 bytes} [Wed Sep 14 20:03:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51860525 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:03:16.913866 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:16.914408 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:16.920803 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:16.921284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:16.921722 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:16.922507 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:16.922959 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:16.923383 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:16.936983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] HTTP exception thrown: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Request method failure captured: Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c HTTP/1.1 Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHGiilxWoD4FTg9nekXuBhW1-7liAs-hfyDuo2saLPSKMBQunBkGnoiANwd7QUiqXFLNRgqdsGlc5W37RRTFv6syCzGol-rwwx3RzQOSDdEigbwbiWHwuY6Z4ZFz85JOIhbNV5oJBgGAjdh_5nnN0Cy5uIQztxTwoa12hPNcF6c5Sw Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:16.938536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e52433815b1440de8bfe05dc7d14b7f5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}] Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 268dbf54f29c40d9a4daa772c44735d4 Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '8067613a-f4df-44e1-9aa6-b6d7a39a119c'} Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:16.946695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.948193 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.949653 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Returning 404 to user: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:16.949653 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f72c8c16-932d-4672-8f26-adbb13e0509f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 404 len: 111 microversion: 2.1 time: 0.029961 Sep 14 20:03:16.949653 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 505/988] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:03:16 2022] DELETE /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:16.953146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:16.953851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: 8067613a-f4df-44e1-9aa6-b6d7a39a119c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:16.961206 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:16.961708 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:16.962194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:16.962873 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:16.963324 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:16.963743 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:16.976898 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] HTTP exception thrown: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Request method failure captured: Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c HTTP/1.1 Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHGiilxWoD4FTg9nekXuBhW1-7liAs-hfyDuo2saLPSKMBQunBkGnoiANwd7QUiqXFLNRgqdsGlc5W37RRTFv6syCzGol-rwwx3RzQOSDdEigbwbiWHwuY6Z4ZFz85JOIhbNV5oJBgGAjdh_5nnN0Cy5uIQztxTwoa12hPNcF6c5Sw Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:03:16.978729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e52433815b1440de8bfe05dc7d14b7f5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}] Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 268dbf54f29c40d9a4daa772c44735d4 Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.980318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '8067613a-f4df-44e1-9aa6-b6d7a39a119c'} Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:16.981244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. Sep 14 20:03:16.982529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:16.983911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Returning 404 to user: Instance 8067613a-f4df-44e1-9aa6-b6d7a39a119c could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:16.983911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-673e0448-2ceb-45aa-b07e-38800a75020b tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c" status: 404 len: 111 microversion: 2.1 time: 0.030785 Sep 14 20:03:16.983911 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 484/989] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:16 2022] GET /compute/v2.1/servers/8067613a-f4df-44e1-9aa6-b6d7a39a119c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:18.346875 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:18.347354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:18.353734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:18.354271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:18.354700 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:18.355375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:18.355819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:18.356235 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:18.369204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] HTTP exception thrown: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Request method failure captured: Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: DELETE /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 HTTP/1.1 Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHGiilxWoD4FTg9nekXuBhW1-7liAs-hfyDuo2saLPSKMBQunBkGnoiANwd7QUiqXFLNRgqdsGlc5W37RRTFv6syCzGol-rwwx3RzQOSDdEigbwbiWHwuY6Z4ZFz85JOIhbNV5oJBgGAjdh_5nnN0Cy5uIQztxTwoa12hPNcF6c5Sw Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:18.370755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e52433815b1440de8bfe05dc7d14b7f5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}] Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 268dbf54f29c40d9a4daa772c44735d4 Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.372282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'f70804c4-376b-4606-bd6f-4414c9892629'} Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:18.373203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.374663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.376164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Returning 404 to user: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:18.376164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8ac18fe6-b66c-43ca-ae30-e03aef3dbbc5 tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 404 len: 111 microversion: 2.1 time: 0.029689 Sep 14 20:03:18.376164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 506/990] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:03:18 2022] DELETE /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:18.380576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:18.381195 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] [instance: f70804c4-376b-4606-bd6f-4414c9892629] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:18.387490 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:18.387977 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:18.388478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:18.389133 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:18.389593 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:18.390050 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:18.403641 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] HTTP exception thrown: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Request method failure captured: Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 HTTP/1.1 Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHGiilxWoD4FTg9nekXuBhW1-7liAs-hfyDuo2saLPSKMBQunBkGnoiANwd7QUiqXFLNRgqdsGlc5W37RRTFv6syCzGol-rwwx3RzQOSDdEigbwbiWHwuY6Z4ZFz85JOIhbNV5oJBgGAjdh_5nnN0Cy5uIQztxTwoa12hPNcF6c5Sw Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:03:18.405150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e52433815b1440de8bfe05dc7d14b7f5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e52433815b1440de8bfe05dc7d14b7f5"}]}] Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: e52433815b1440de8bfe05dc7d14b7f5 Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeTestJSON-900297640 Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 268dbf54f29c40d9a4daa772c44735d4 Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeTestJSON-900297640-project Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.406774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'f70804c4-376b-4606-bd6f-4414c9892629'} Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:18.407656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. Sep 14 20:03:18.409828 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:18.411170 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] Returning 404 to user: Instance f70804c4-376b-4606-bd6f-4414c9892629 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:18.411170 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a103b715-e416-494c-8862-e8549b5d515f tempest-AttachVolumeTestJSON-900297640 tempest-AttachVolumeTestJSON-900297640-project] 10.222.0.42 "GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629" status: 404 len: 111 microversion: 2.1 time: 0.029813 Sep 14 20:03:18.411170 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 485/991] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:18 2022] GET /compute/v2.1/servers/f70804c4-376b-4606-bd6f-4414c9892629 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:23.062253 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:23.064393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:23.071276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:23.071756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:23.072191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:23.072872 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:23.073316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:23.073733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:23.107904 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8ed8f2e6-7779-4e6f-a71a-4978b542bdb5 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049600 Sep 14 20:03:23.108640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 507/992] 10.222.0.42 () {60 vars in 1343 bytes} [Wed Sep 14 20:03:23 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:23.178583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:23.179080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:23.185715 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:23.186237 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:23.186677 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:23.187431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:23.187915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:23.188340 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:23.214339 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:03:23.484417 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d39d041d-77a3-4d88-9ea8-e0f0fcd090dd tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 204 len: 0 microversion: 2.20 time: 0.309525 Sep 14 20:03:23.484999 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 486/993] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 20:03:23 2022] DELETE /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 20:03:23.494063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:23.494911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:23.500843 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:23.501559 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:23.502291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:23.503496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:23.503947 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:23.504740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:23.636126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:23.644751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:23.646213 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:23.647363 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fb314f0d-c1d8-46da-a790-1b27dd017c85 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.157107 Sep 14 20:03:23.647914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 508/994] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:03:23 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:03:24.673428 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:24.674071 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:24.681307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:24.681793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:24.682271 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:24.682960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:24.683452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:24.683868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:24.814378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:24.822559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:24.823997 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:24.825257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4383b657-0434-482b-bf2d-0ebbac23ae3a tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1725 microversion: 2.20 time: 0.156232 Sep 14 20:03:24.825836 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 487/995] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:03:24 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:03:25.852272 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:25.852954 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:25.862905 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:25.863657 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:25.864181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:25.864970 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:25.865464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:25.866003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:25.941873 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:25.950524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:25.952037 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:25.954271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-05662407-bbf6-4701-af5b-e261320d6479 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1657 microversion: 2.20 time: 0.105276 Sep 14 20:03:25.954271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 509/996] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:03:25 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1657 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:03:26.242794 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-e37505c9-c0e1-41b5-ba16-7690d770218e req-c6a9ac0c-e197-475f-8596-1ec11f0860b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d406a90-e67e-4623-9697-11b9ed133316", "name": "network-vif-deleted", "tag": "25548a24-9696-4819-a2ea-b4a68fdf3d55"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:03:26.253631 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e37505c9-c0e1-41b5-ba16-7690d770218e req-c6a9ac0c-e197-475f-8596-1ec11f0860b2 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:26.254131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e37505c9-c0e1-41b5-ba16-7690d770218e req-c6a9ac0c-e197-475f-8596-1ec11f0860b2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:26.254556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-e37505c9-c0e1-41b5-ba16-7690d770218e req-c6a9ac0c-e197-475f-8596-1ec11f0860b2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:26.266101 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-e37505c9-c0e1-41b5-ba16-7690d770218e req-c6a9ac0c-e197-475f-8596-1ec11f0860b2 service nova] Creating event network-vif-deleted:25548a24-9696-4819-a2ea-b4a68fdf3d55 for instance 2d406a90-e67e-4623-9697-11b9ed133316 on hv-cinder-83976 Sep 14 20:03:26.271693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-e37505c9-c0e1-41b5-ba16-7690d770218e req-c6a9ac0c-e197-475f-8596-1ec11f0860b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032845 Sep 14 20:03:26.272329 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 488/997] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:26.980581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:26.981477 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:26.989954 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:26.990525 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:26.991149 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:26.991860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:26.992311 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:26.993397 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:27.029156 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:27.029664 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:27.030120 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:27.030654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lazy-loading 'fault' on Instance uuid 2d406a90-e67e-4623-9697-11b9ed133316 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:03:27.083891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:27.088687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:27.090291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bf1c7a6cc2e4b1294e7b162a8aba738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb5ca35665545119e4ca1f379c37a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:27.091530 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bf600e4c-3ddd-4266-abe6-b773ff58d9ee tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 200 len: 1371 microversion: 2.20 time: 0.115395 Sep 14 20:03:27.092408 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 510/998] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:03:26 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 20:03:28.125703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:28.126425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:28.132579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:28.133059 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:28.139492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:28.139492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:28.139492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:28.139492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:28.148879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] HTTP exception thrown: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Request method failure captured: Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 HTTP/1.1 Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHE7kGcbR3e7IB_4bxxGEt9cUzDCSNZ1QLToLfVFYRq6PRlOEp4-mDKH7_i8_Uaq0af1pK_MrNwX7F1GhFLdVXAjVGtv9d8NNUnaQsXI_nndlSXKNDZsJYfcnRziTTLsPIL8WwybaZTuWIREnGGPxutxTm3Z6fi6_ilPL7vX8SIH7c Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:03:28.150563 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdb5ca35665545119e4ca1f379c37a73", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}] Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 2bf1c7a6cc2e4b1294e7b162a8aba738 Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:28.152228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '2d406a90-e67e-4623-9697-11b9ed133316'} Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:28.153124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:28.154758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:28.156011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Returning 404 to user: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:28.156011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1bd75060-0309-4267-a016-4594cdf7dd99 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 404 len: 111 microversion: 2.20 time: 0.030996 Sep 14 20:03:28.156011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 489/999] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:03:28 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:03:28.161703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a9ce5b49-e5b7-409d-af3c-769cc1758325 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '.version_select at 0x7f19e8e255e0>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:28.240267 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a9ce5b49-e5b7-409d-af3c-769cc1758325 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459509858" status: 204 len: 0 microversion: 2.20 time: 0.082919 Sep 14 20:03:28.244062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 511/1000] 10.222.0.42 () {60 vars in 1259 bytes} [Wed Sep 14 20:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459509858 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 20:03:30.263266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:30.267514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:30.270119 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:30.270599 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:30.271026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:30.271706 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:30.272152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:30.272572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:30.287908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] HTTP exception thrown: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Request method failure captured: Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 HTTP/1.1 Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHE7kGcbR3e7IB_4bxxGEt9cUzDCSNZ1QLToLfVFYRq6PRlOEp4-mDKH7_i8_Uaq0af1pK_MrNwX7F1GhFLdVXAjVGtv9d8NNUnaQsXI_nndlSXKNDZsJYfcnRziTTLsPIL8WwybaZTuWIREnGGPxutxTm3Z6fi6_ilPL7vX8SIH7c Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:03:30.289453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdb5ca35665545119e4ca1f379c37a73", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}] Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 2bf1c7a6cc2e4b1294e7b162a8aba738 Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.291126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '2d406a90-e67e-4623-9697-11b9ed133316'} Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:30.292026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.293456 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.294906 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Returning 404 to user: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:30.294906 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-718f4763-720f-47d9-92e1-42f0f0328ff7 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 404 len: 111 microversion: 2.20 time: 0.031512 Sep 14 20:03:30.294906 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 490/1001] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 20:03:30 2022] DELETE /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:03:30.300282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:30.300886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 2d406a90-e67e-4623-9697-11b9ed133316] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:30.307314 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:30.307789 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:30.308220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:30.308898 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:30.309345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:30.309764 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:30.323128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] HTTP exception thrown: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Request method failure captured: Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 HTTP/1.1 Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHE7kGcbR3e7IB_4bxxGEt9cUzDCSNZ1QLToLfVFYRq6PRlOEp4-mDKH7_i8_Uaq0af1pK_MrNwX7F1GhFLdVXAjVGtv9d8NNUnaQsXI_nndlSXKNDZsJYfcnRziTTLsPIL8WwybaZTuWIREnGGPxutxTm3Z6fi6_ilPL7vX8SIH7c Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:30.324663 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdb5ca35665545119e4ca1f379c37a73", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}] Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 2bf1c7a6cc2e4b1294e7b162a8aba738 Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.326303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '2d406a90-e67e-4623-9697-11b9ed133316'} Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:30.327194 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. Sep 14 20:03:30.328644 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:30.329925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Returning 404 to user: Instance 2d406a90-e67e-4623-9697-11b9ed133316 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:30.329925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-2f1ae43f-5851-4c72-aa7c-bee8e9f35b83 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316" status: 404 len: 111 microversion: 2.20 time: 0.030509 Sep 14 20:03:30.329925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 512/1002] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:03:30 2022] GET /compute/v2.1/servers/2d406a90-e67e-4623-9697-11b9ed133316 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:03:31.594735 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:31.595250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:31.602451 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:31.602923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:31.603348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:31.604021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:31.604466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:31.604926 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:31.618588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] HTTP exception thrown: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Request method failure captured: Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a HTTP/1.1 Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjHE7kGcbR3e7IB_4bxxGEt9cUzDCSNZ1QLToLfVFYRq6PRlOEp4-mDKH7_i8_Uaq0af1pK_MrNwX7F1GhFLdVXAjVGtv9d8NNUnaQsXI_nndlSXKNDZsJYfcnRziTTLsPIL8WwybaZTuWIREnGGPxutxTm3Z6fi6_ilPL7vX8SIH7c Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:03:31.620185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdb5ca35665545119e4ca1f379c37a73", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}] Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 2bf1c7a6cc2e4b1294e7b162a8aba738 Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.621894 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a'} Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:31.622839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.624350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.625852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Returning 404 to user: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:31.625852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ce60c4a9-362c-423f-b792-fe98d8e9907d tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 404 len: 111 microversion: 2.20 time: 0.030899 Sep 14 20:03:31.625852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 491/1003] 10.222.0.42 () {60 vars in 1280 bytes} [Wed Sep 14 20:03:31 2022] DELETE /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:03:31.630103 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:31.630742 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] [instance: 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:31.637163 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:31.637640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:31.638101 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:31.639286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:31.639286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:31.639619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:31.653113 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] HTTP exception thrown: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Request method failure captured: Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a HTTP/1.1 Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjHE7kGcbR3e7IB_4bxxGEt9cUzDCSNZ1QLToLfVFYRq6PRlOEp4-mDKH7_i8_Uaq0af1pK_MrNwX7F1GhFLdVXAjVGtv9d8NNUnaQsXI_nndlSXKNDZsJYfcnRziTTLsPIL8WwybaZTuWIREnGGPxutxTm3Z6fi6_ilPL7vX8SIH7c Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:31.654659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bdb5ca35665545119e4ca1f379c37a73", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bdb5ca35665545119e4ca1f379c37a73"}]}] Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: bdb5ca35665545119e4ca1f379c37a73 Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-434915186 Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 2bf1c7a6cc2e4b1294e7b162a8aba738 Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-434915186-project Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.658228 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a'} Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:31.659259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. Sep 14 20:03:31.660721 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:31.662564 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] Returning 404 to user: Instance 9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:31.662564 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1c053dc7-ea98-4d7d-9ed2-9a86e2b013d2 tempest-AttachVolumeShelveTestJSON-434915186 tempest-AttachVolumeShelveTestJSON-434915186-project] 10.222.0.42 "GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a" status: 404 len: 111 microversion: 2.20 time: 0.029893 Sep 14 20:03:31.662564 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 513/1004] 10.222.0.42 () {60 vars in 1277 bytes} [Wed Sep 14 20:03:31 2022] GET /compute/v2.1/servers/9e77a07b-e08c-4a2a-af56-e1ce69ab8e5a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 20:03:35.277532 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:35.278063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:35.280952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:35.290868 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:35.291371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:35.291818 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:35.292524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:35.292982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:35.294078 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:35.297904 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:35.319073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7346b38f-8571-42c1-a236-934935c1b78d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/ips" status: 200 len: 149 microversion: 2.1 time: 0.044955 Sep 14 20:03:35.319593 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 492/1005] 10.222.0.42 () {58 vars in 1248 bytes} [Wed Sep 14 20:03:35 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:36.985459 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2212e0f9-4e47-421f-a0a4-1e76991a1178"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:03:36.988072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:36.995892 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:36.997574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:36.998274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:36.998705 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:36.999400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:36.999844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:37.000442 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:37.004346 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:37.876786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b9985fa8-73ec-4306-901b-249f818d8894 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "POST /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895071 Sep 14 20:03:37.877656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 514/1006] 10.222.0.42 () {60 vars in 1323 bytes} [Wed Sep 14 20:03:36 2022] POST /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:47.688027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:47.689886 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:47.696200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:47.696690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:47.697127 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:47.697843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:47.698300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:47.698726 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:47.785088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'services' on Instance uuid 58c0ade0-a9e0-476e-a02a-9255d28776d3 {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:03:48.010024 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-cc4f55e5-8a2a-4baf-bbd2-bf31fcc688cc tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments/2212e0f9-4e47-421f-a0a4-1e76991a1178" status: 202 len: 0 microversion: 2.1 time: 0.326565 Sep 14 20:03:48.010619 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 493/1007] 10.222.0.42 () {58 vars in 1416 bytes} [Wed Sep 14 20:03:47 2022] DELETE /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments/2212e0f9-4e47-421f-a0a4-1e76991a1178 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:03:48.016562 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:48.020961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:03:48.021444 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:48.023801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:48.029860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:48.030387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:48.030873 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:48.031574 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:48.032032 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:48.032462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:48.064254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1ceef5a9-aba9-4d45-8ec7-0e9a31976df0 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049026 Sep 14 20:03:48.065045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 515/1008] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:03:48 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:49.077753 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:49.080042 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:49.100969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:49.100969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:49.100969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:49.100969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:49.101335 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:49.101335 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:49.118885 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-79374a01-0941-4571-ac0e-1a86fae63115 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Sep 14 20:03:49.119443 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 494/1009] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:03:49 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:50.132160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:50.134467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:50.141337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:50.146352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:50.146352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:50.146352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:50.146352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:50.146734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:50.172376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-58da7c89-4069-4e73-b302-6e52bf50651d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044867 Sep 14 20:03:50.173163 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 516/1010] 10.222.0.42 () {58 vars in 1302 bytes} [Wed Sep 14 20:03:50 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 20:03:50.253087 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:50.253592 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:50.259964 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:50.260449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:50.260884 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:50.261569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:50.262055 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:50.266816 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:50.287782 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:03:50.587715 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-27d911ac-b855-47a4-abd9-afdc56ec1b62 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 204 len: 0 microversion: 2.1 time: 0.338141 Sep 14 20:03:50.593061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 495/1011] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:03:50 2022] DELETE /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:03:50.600238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:50.600848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:50.607297 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:50.607772 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:50.608207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:50.608886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:50.609332 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:50.609750 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:50.740329 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:50.747983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-68ee1359-c42b-41b7-ab4a-380ebd4e0032 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1680 microversion: 2.1 time: 0.151915 Sep 14 20:03:50.753069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 517/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:50 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:51.776717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:51.777423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:51.783779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:51.784272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:51.784711 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:51.785442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:51.786057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:51.786527 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:51.927595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:51.935255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7449b091-617e-4c10-85a2-870abfc0d72c tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1680 microversion: 2.1 time: 0.163188 Sep 14 20:03:51.950039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 496/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:51 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:52.958283 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:52.959104 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:52.968072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:52.971844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:52.971844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:52.971844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:52.971844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:52.972293 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:53.122578 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:53.130459 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ff7bb265-5cb1-4140-a7b4-fe655c19ee7b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1680 microversion: 2.1 time: 0.176541 Sep 14 20:03:53.131014 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 518/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:52 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:53.479664 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-2ef2f35c-5398-409e-a2a3-1e729c0ddbb8 req-be8ab518-673c-43db-b320-7ce734aa39a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c0ade0-a9e0-476e-a02a-9255d28776d3", "name": "network-vif-deleted", "tag": "7ac88e64-0677-4a93-a678-ff412ef102b6"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:03:53.493022 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2ef2f35c-5398-409e-a2a3-1e729c0ddbb8 req-be8ab518-673c-43db-b320-7ce734aa39a0 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:53.493859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2ef2f35c-5398-409e-a2a3-1e729c0ddbb8 req-be8ab518-673c-43db-b320-7ce734aa39a0 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:53.494489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2ef2f35c-5398-409e-a2a3-1e729c0ddbb8 req-be8ab518-673c-43db-b320-7ce734aa39a0 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:53.507748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-2ef2f35c-5398-409e-a2a3-1e729c0ddbb8 req-be8ab518-673c-43db-b320-7ce734aa39a0 service nova] Creating event network-vif-deleted:7ac88e64-0677-4a93-a678-ff412ef102b6 for instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 on hv-cinder-83976 Sep 14 20:03:53.513083 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-2ef2f35c-5398-409e-a2a3-1e729c0ddbb8 req-be8ab518-673c-43db-b320-7ce734aa39a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037770 Sep 14 20:03:53.513477 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 497/1015] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:03:54.160457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:54.160998 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:54.169447 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:54.169849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:54.171198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:54.171929 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:54.172381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:54.173439 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:54.219085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:54.219573 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:54.220008 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:54.220456 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lazy-loading 'fault' on Instance uuid 58c0ade0-a9e0-476e-a02a-9255d28776d3 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:03:54.262668 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be0920bd9b934f039e5e4de8039346b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d8e3f408bde455b86274e11fa626eb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:54.270810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5fa8839d-e078-480a-ac6d-2c57560c4f9d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 200 len: 1331 microversion: 2.1 time: 0.114447 Sep 14 20:03:54.271454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 519/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:54 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:03:55.303683 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:55.304729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:55.311875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:55.312458 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:55.312988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:55.313899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:55.314630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:55.315137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:55.330493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 HTTP/1.1 Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:03:55.332229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:55.334115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '58c0ade0-a9e0-476e-a02a-9255d28776d3'} Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:55.334950 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:55.337455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:55.338680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:55.338680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a91075ad-a25b-4ff9-984c-18e0b6c0623f tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 404 len: 111 microversion: 2.1 time: 0.034502 Sep 14 20:03:55.338680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 498/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:55 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:55.343622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1a149fae-4fbb-418e-854f-54d3edbbd227 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '.version_select at 0x7f19e8e25040>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:55.434291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1a149fae-4fbb-418e-854f-54d3edbbd227 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860888469" status: 202 len: 0 microversion: 2.1 time: 0.094336 Sep 14 20:03:55.434862 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 520/1018] 10.222.0.42 () {58 vars in 1218 bytes} [Wed Sep 14 20:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860888469 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:03:57.670562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:57.671080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:57.677898 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:57.678028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:57.678357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:57.679041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:57.679495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:57.679922 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:57.696310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: DELETE /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 HTTP/1.1 Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:03:57.697905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.699495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '58c0ade0-a9e0-476e-a02a-9255d28776d3'} Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:57.700369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.701618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.702887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:57.702887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1bf479ce-8402-482c-b9cb-99becf08f5fa tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 404 len: 111 microversion: 2.1 time: 0.032679 Sep 14 20:03:57.702887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 499/1019] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:03:57 2022] DELETE /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:57.708656 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:57.709962 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 58c0ade0-a9e0-476e-a02a-9255d28776d3] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:57.717992 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:57.718482 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:57.718919 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:57.719612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:57.720068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:57.720493 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:57.734589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 HTTP/1.1 Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:57.738901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.748216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '58c0ade0-a9e0-476e-a02a-9255d28776d3'} Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:57.749205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. Sep 14 20:03:57.751582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:57.753236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 58c0ade0-a9e0-476e-a02a-9255d28776d3 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:57.753236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b650c423-44ae-4b30-89b5-cd42a2bb1b78 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3" status: 404 len: 111 microversion: 2.1 time: 0.033490 Sep 14 20:03:57.753236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 521/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:57 2022] GET /compute/v2.1/servers/58c0ade0-a9e0-476e-a02a-9255d28776d3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:58.963063 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:03:58.963584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:58.969993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:58.970481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:58.970918 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:58.971622 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:58.972062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:58.972483 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:58.997710 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lazy-loading 'flavor' on Instance uuid a16963b9-9ad4-4a98-b1bc-eeca734dab8c {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:03:59.150168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:59.150673 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:59.157230 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.157707 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.158173 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.158896 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.159344 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.166289 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.173554 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: DELETE /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e HTTP/1.1 Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:59.175016 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.176630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e'} Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:59.177716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.179301 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.180801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:59.180801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7f2cab02-c8ca-44ea-96ee-39e9a3257a0d tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 404 len: 111 microversion: 2.1 time: 0.030590 Sep 14 20:03:59.180801 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 522/1021] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:03:59 2022] DELETE /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:59.184473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:59.185069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:59.191200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.191675 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.192102 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.192783 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.193233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.193648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.221535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e HTTP/1.1 Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:59.223812 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.225560 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e'} Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:59.226496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. Sep 14 20:03:59.228536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.231604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:59.232829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ce5da246-de61-41e2-96bd-7ae648b05a36 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e" status: 404 len: 111 microversion: 2.1 time: 0.051947 Sep 14 20:03:59.233554 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 523/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:59 2022] GET /compute/v2.1/servers/89ed314d-8cfe-49e3-9fd1-412fcb1e8e7e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:59.248308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:59.249022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:59.255912 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.256402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.256835 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.257519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.258002 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.258460 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.272604 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: DELETE /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 HTTP/1.1 Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:59.274928 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.276538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'e55857d3-b341-41f5-b675-dcb6b621d7a6'} Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:59.277307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.282362 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.284059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:59.284059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-44fa28cc-18b3-4f8f-b39b-d4989d6ba6a2 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 404 len: 111 microversion: 2.1 time: 0.032225 Sep 14 20:03:59.284059 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 524/1023] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:03:59 2022] DELETE /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:59.290631 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:59.291393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: e55857d3-b341-41f5-b675-dcb6b621d7a6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:59.297387 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.297901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.298567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.299590 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.300368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.300975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.318285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 HTTP/1.1 Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:03:59.319818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.321518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'e55857d3-b341-41f5-b675-dcb6b621d7a6'} Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:03:59.322948 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. Sep 14 20:03:59.324250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:03:59.325746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance e55857d3-b341-41f5-b675-dcb6b621d7a6 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:03:59.325746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d8e8e166-55f8-46e6-a4ec-c0e3a8a56287 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6" status: 404 len: 111 microversion: 2.1 time: 0.035527 Sep 14 20:03:59.325746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 525/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:59 2022] GET /compute/v2.1/servers/e55857d3-b341-41f5-b675-dcb6b621d7a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:03:59.358846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-45b1e347-3da9-4431-b0c2-7c77be62f52c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "POST /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c/action" status: 202 len: 0 microversion: 2.1 time: 0.399986 Sep 14 20:03:59.359431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 500/1025] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 20:03:58 2022] POST /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:03:59.368441 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:03:59.369266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:03:59.375476 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.375958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.376383 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.377067 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:03:59.377520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:03:59.378012 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:03:59.518431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:03:59.534855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-641db3eb-8104-4558-bacd-b373c353582e tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.164976 Sep 14 20:03:59.534855 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 526/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:03:59 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:00.554153 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:00.554920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:00.561674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:00.562639 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:00.563101 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:00.563799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:00.564255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:00.564678 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:00.697023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:00.697730 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:00.705270 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:00.710893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:00.712023 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:00.712464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:00.713169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:00.713623 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:00.714039 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4a97c2af-d234-4f51-a0c5-efffe2190e11 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.164670 Sep 14 20:04:00.714148 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:00.714614 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 501/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:00 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:00.728578 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: DELETE /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 HTTP/1.1 Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:04:00.731053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.732692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '1639318a-4654-444a-9f8b-34640c1cdde6'} Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:04:00.733591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.735097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.736553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:04:00.736553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b252f1cf-ebc1-4814-b30e-c7244a0e5c3b tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 404 len: 111 microversion: 2.1 time: 0.039274 Sep 14 20:04:00.736553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 527/1028] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:04:00 2022] DELETE /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 20:04:00.741060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:00.741683 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] [instance: 1639318a-4654-444a-9f8b-34640c1cdde6] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:00.747882 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:00.748312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:00.748813 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:00.749523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:00.750023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:00.750517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:00.763951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] HTTP exception thrown: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Request method failure captured: Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 HTTP/1.1 Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjIfWW7mxPeczE6KsGAV4NuzwB2Xr_JfM68qQsZk4_0iHdtKK8RAEBycYWNRsyVPmldJ2PC3H75WCxmoJwGqBRfz401BtNh6a7SB2IJDp-05eudsrFjtBJ6BBCwsDxJdQhQL85Bxu566Gh5zZwtfl6ZDJLOc4cwS3u2V0faCqJcpzLg Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:04:00.765627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5d8e3f408bde455b86274e11fa626eb4", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5d8e3f408bde455b86274e11fa626eb4"}]}] Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 5d8e3f408bde455b86274e11fa626eb4 Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10772151 Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: be0920bd9b934f039e5e4de8039346b8 Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-AttachVolumeNegativeTest-10772151-project Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.767257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '1639318a-4654-444a-9f8b-34640c1cdde6'} Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:04:00.768176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. Sep 14 20:04:00.769644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:04:00.774799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] Returning 404 to user: Instance 1639318a-4654-444a-9f8b-34640c1cdde6 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:04:00.774799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-48298f80-112f-43f7-8f61-04fa7e989009 tempest-AttachVolumeNegativeTest-10772151 tempest-AttachVolumeNegativeTest-10772151-project] 10.222.0.42 "GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6" status: 404 len: 111 microversion: 2.1 time: 0.029839 Sep 14 20:04:00.774799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 502/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:00 2022] GET /compute/v2.1/servers/1639318a-4654-444a-9f8b-34640c1cdde6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:04:01.737579 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:01.738231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:01.745198 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:01.745689 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:01.746171 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:01.746949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:01.747410 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:01.747842 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:01.971859 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:01.981942 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0fc240c6-a83e-4867-9feb-ef9cb5ef6288 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.248128 Sep 14 20:04:01.996364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 528/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:01 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:03.006716 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:03.008150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:03.019214 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:03.022265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:03.024842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:03.025746 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:03.028295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:03.029060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:03.278208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:03.287243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c0401620-97ed-4dde-9ae4-20ac5f189e4f tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.284631 Sep 14 20:04:03.288344 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 503/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:03 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:04.312201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:04.312818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:04.319291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:04.319782 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:04.320220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:04.321441 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:04.321920 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:04.322349 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:04.492191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:04.503521 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4c75f153-ed73-4749-9ab0-003d5e39f4c3 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.194250 Sep 14 20:04:04.504976 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 529/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:04 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:05.528211 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:05.528827 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:05.535212 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:05.535693 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:05.536187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:05.536875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:05.537322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:05.537741 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:05.687311 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:05.697099 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8aa7d6f8-1767-46e1-82b2-3c265beff2fb tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.173319 Sep 14 20:04:05.698668 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 504/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:05 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:06.720624 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:06.721402 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:06.734348 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:06.734741 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:06.735641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:06.736211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:06.736328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:06.736774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:06.881957 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:06.893473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-01c18cd4-492f-4a63-ae59-e61a38b9a8a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.176785 Sep 14 20:04:06.894177 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 530/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:06 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:07.923199 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:07.924367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:07.933369 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:07.934007 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:07.934562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:07.935363 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:07.936146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:07.937020 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:08.123588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:08.133586 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6fbb493b-9eb6-4913-aa03-731669bda163 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.214295 Sep 14 20:04:08.134366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 505/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:07 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:09.158564 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:09.159520 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:09.170597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:09.170597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:09.170597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:09.170597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:09.170992 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:09.170992 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:09.305667 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:09.313588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-913b710a-b7f0-4c0e-bba1-bc2acca24de5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.159156 Sep 14 20:04:09.314181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 531/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:09 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:10.337648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:10.340244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:10.344371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:10.344857 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:10.345322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:10.346201 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:10.347030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:10.347449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:10.758188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:10.765852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c1068313-1a8f-401d-9111-df77ae07a571 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.432635 Sep 14 20:04:10.766648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 506/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:10 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:11.790908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:11.791544 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:11.798169 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:11.803280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:11.803280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:11.803280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:11.803280 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:11.803640 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:11.941386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:11.949923 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a2a0d92b-adea-4ecd-9803-726d99ec1b51 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.163658 Sep 14 20:04:11.950471 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 532/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:11 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:12.974324 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:12.975521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:12.986489 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:12.986981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:12.987420 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:12.988185 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:12.988637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:12.989064 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:13.016740 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:13.136654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:13.145086 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-5fd541a6-5922-46ab-8456-bfef087350d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1571 microversion: 2.1 time: 0.174941 Sep 14 20:04:13.146192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 507/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:12 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:13.170307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:04:13.170894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:13.177395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:13.177979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:13.178410 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:13.179092 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:13.179653 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:13.180556 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:13.224032 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132861) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 20:04:13.620242 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [8b838899-0953-4163-b93f-3316b28694bc] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 20:04:14.627433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO oslo.messaging._drivers.impl_rabbit [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [8b838899-0953-4163-b93f-3316b28694bc] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 58008. Sep 14 20:04:14.630821 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-26274f95-9591-4e78-b655-af5c56d1f2af tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "POST /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c/action" status: 202 len: 0 microversion: 2.1 time: 1.464645 Sep 14 20:04:14.631422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 533/1040] 10.222.0.42 () {60 vars in 1278 bytes} [Wed Sep 14 20:04:13 2022] POST /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c/action => generated 0 bytes in 1466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:04:14.639733 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:14.640347 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:14.648210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:14.651204 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:14.651204 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:14.651204 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:14.651204 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:14.651618 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:14.784524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:14.793312 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-3d6fd7fe-67c6-4196-801a-cf31f91ec2ed tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1519 microversion: 2.1 time: 0.157652 Sep 14 20:04:14.793918 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 508/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:14 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:15.817388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:15.817996 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:15.825630 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:15.831563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:15.831563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:15.831563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:15.831563 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:15.832376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:15.960294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:15.968584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-724d35b4-79bf-4be4-b62f-c88fa035c5d9 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1519 microversion: 2.1 time: 0.155908 Sep 14 20:04:15.969155 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 534/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:15 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:16.996848 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:16.997469 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:17.005043 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:17.009862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:17.009862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:17.009862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:17.009862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:17.010277 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:17.138509 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:17.146439 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fab9ae5f-8255-40a6-8b52-7442f9983f3a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1521 microversion: 2.1 time: 0.154311 Sep 14 20:04:17.147007 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 509/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:16 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:17.745256 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-4ccdc902-1fe6-4ddd-baf7-4e4346798798 req-c4004e49-536f-496a-a9a0-dcd8a8959dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16963b9-9ad4-4a98-b1bc-eeca734dab8c", "name": "network-vif-unplugged", "status": "completed", "tag": "ef0f455b-8116-43f0-96ef-d2554406ee03"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:04:17.761250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4ccdc902-1fe6-4ddd-baf7-4e4346798798 req-c4004e49-536f-496a-a9a0-dcd8a8959dfb service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:17.762426 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4ccdc902-1fe6-4ddd-baf7-4e4346798798 req-c4004e49-536f-496a-a9a0-dcd8a8959dfb service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:17.762786 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-4ccdc902-1fe6-4ddd-baf7-4e4346798798 req-c4004e49-536f-496a-a9a0-dcd8a8959dfb service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:17.767279 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:17.776322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-4ccdc902-1fe6-4ddd-baf7-4e4346798798 req-c4004e49-536f-496a-a9a0-dcd8a8959dfb service nova] Creating event network-vif-unplugged:ef0f455b-8116-43f0-96ef-d2554406ee03 for instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c on hv-cinder-83976 Sep 14 20:04:17.781450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-4ccdc902-1fe6-4ddd-baf7-4e4346798798 req-c4004e49-536f-496a-a9a0-dcd8a8959dfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039827 Sep 14 20:04:17.782196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 535/1044] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:04:18.171537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:18.172571 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:18.182226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:18.184679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:18.185395 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:18.185854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:18.186556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:18.187181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:18.187612 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:18.341106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:18.350634 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-97ec7acf-fe9f-43f9-a6e2-4d50d60d33d8 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.183265 Sep 14 20:04:18.351215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 510/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:18 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:19.375803 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:19.376491 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:19.382877 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:19.383351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:19.383784 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:19.385069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:19.385517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:19.385962 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:19.520418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:19.529099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a70d1543-e997-4b90-9bd0-911841c4db3c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.158191 Sep 14 20:04:19.529464 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 536/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:19 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:20.552398 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:20.553014 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:20.560870 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:20.561351 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:20.562016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:20.562647 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:20.563097 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:20.563517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:20.730194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:20.738115 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ee237691-a12e-475b-b8f4-94dc44d61c96 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.189490 Sep 14 20:04:20.738686 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 511/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:20 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:21.763993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:21.764713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:21.767414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:21.779164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:21.779657 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:21.780249 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:21.780961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:21.781416 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:21.781862 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:21.916772 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:21.924864 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f031dba4-d954-4ace-b1fd-f0547cc31f6c tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.166162 Sep 14 20:04:21.925271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 537/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:21 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:22.948636 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:22.949282 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:22.955665 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:22.956146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:22.956587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:22.957298 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:22.957748 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:22.958200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:23.117934 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:23.125655 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-76c1251c-d28e-4f87-9f98-b6118d11a17a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.181443 Sep 14 20:04:23.126272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 512/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:22 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:24.150858 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:24.151479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:24.158291 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:24.158779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:24.159216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:24.159907 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:24.160360 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:24.160781 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:24.297634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:24.306182 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d315002e-dc92-4a34-9da3-00b3a79fb1da tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.160005 Sep 14 20:04:24.306746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 538/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:24 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:25.330301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:25.330852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:25.337822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:25.338393 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:25.338834 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:25.339526 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:25.344042 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:25.344042 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:25.495922 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:25.509556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6e900599-b42e-4815-9650-b92bba31c156 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.183278 Sep 14 20:04:25.510194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 513/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:25 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:26.532829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:26.533482 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:26.540105 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:26.540588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:26.541525 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:26.545063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:26.545063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:26.545063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:26.717600 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:26.725335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ba0b8170-c71a-4eca-ba60-397be4eaf5a0 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.196398 Sep 14 20:04:26.725951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 539/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:26 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:27.748940 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:27.749627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:27.756361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:27.756859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:27.757487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:27.758400 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:27.759232 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:27.760543 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:27.978257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:27.986675 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8f548bbe-a3a6-4418-95ba-ffee2fbf4287 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.241593 Sep 14 20:04:27.987240 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 514/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:27 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:29.011126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:29.012031 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:29.018881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:29.019472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:29.019982 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:29.020946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:29.021502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:29.022027 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:29.169878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:29.177772 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fce8efae-21fd-4358-8d5b-af37ee988a45 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.171049 Sep 14 20:04:29.178403 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 540/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:29 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:29.844387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-1e2ffa23-44e8-45b4-bff8-54b8e67eebe2 req-971c484d-685d-4dcf-a18b-e2f98c0626bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16963b9-9ad4-4a98-b1bc-eeca734dab8c", "name": "network-vif-plugged", "status": "completed", "tag": "ef0f455b-8116-43f0-96ef-d2554406ee03"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:04:29.856208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1e2ffa23-44e8-45b4-bff8-54b8e67eebe2 req-971c484d-685d-4dcf-a18b-e2f98c0626bc service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:29.856687 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1e2ffa23-44e8-45b4-bff8-54b8e67eebe2 req-971c484d-685d-4dcf-a18b-e2f98c0626bc service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:29.857109 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-1e2ffa23-44e8-45b4-bff8-54b8e67eebe2 req-971c484d-685d-4dcf-a18b-e2f98c0626bc service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:29.868228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-1e2ffa23-44e8-45b4-bff8-54b8e67eebe2 req-971c484d-685d-4dcf-a18b-e2f98c0626bc service nova] Creating event network-vif-plugged:ef0f455b-8116-43f0-96ef-d2554406ee03 for instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c on hv-cinder-83976 Sep 14 20:04:29.874506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-1e2ffa23-44e8-45b4-bff8-54b8e67eebe2 req-971c484d-685d-4dcf-a18b-e2f98c0626bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034020 Sep 14 20:04:29.875229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 515/1055] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:04:30.206532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:30.209131 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:30.214880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:30.215373 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:30.215813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:30.216735 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:30.217212 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:30.217833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:30.375401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:30.383266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e4da59eb-5982-4646-89e8-aac40847ae70 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.180620 Sep 14 20:04:30.384048 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 541/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:30 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:31.407807 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:31.408689 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:31.415478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:31.416038 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:31.417251 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:31.417987 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:31.418437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:31.418857 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:31.564487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:31.573366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a875cbd0-1db9-4ba2-8b24-ecc53cb0a407 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1577 microversion: 2.1 time: 0.170042 Sep 14 20:04:31.590048 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 516/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:31 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:32.600517 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:32.601211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:32.608586 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:32.609186 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:32.609620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:32.610340 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:32.610785 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:32.611211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:32.741895 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:32.750418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d67d46ef-5076-4598-a038-20c83dca2106 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1564 microversion: 2.1 time: 0.153849 Sep 14 20:04:32.750989 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 542/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:32 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:57.127395 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-770505554", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "networks": [{"uuid": "edee15a4-e8db-4f3c-a785-fcf2a2690f68"}]}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:04:57.135859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=13 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:57.136510 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=53 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:57.183525 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] validate_networks() for [('edee15a4-e8db-4f3c-a785-fcf2a2690f68', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:04:57.538865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:04:57.539286 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:04:57.539814 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:04:57.540219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:04:57.540626 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:04:57.549284 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:57.549779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:57.550218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:57.550939 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:57.551391 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:57.551808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:57.568637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Getting quotas for project b9d4ae2217ce4378aca743ebba32e7d6. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:04:57.575881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Getting quotas for user e763756287b04471bbc6b4f8afd28b8b and project b9d4ae2217ce4378aca743ebba32e7d6. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:04:57.588484 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:04:57.590837 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:04:57.737562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b6affac0-fc99-4325-986d-62e747dbc61a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614540 Sep 14 20:04:57.738164 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 517/1059] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:04:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:04:57.750172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-8600a7dd-1840-446d-9626-1f0249d2219b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:57.750906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-8600a7dd-1840-446d-9626-1f0249d2219b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:57.753660 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=11 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:57.754472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=42 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:04:57.821159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-8600a7dd-1840-446d-9626-1f0249d2219b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:57.831518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-8600a7dd-1840-446d-9626-1f0249d2219b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1213 microversion: 2.1 time: 0.085821 Sep 14 20:04:57.832099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 543/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:57 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:04:58.855635 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:58.856363 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:58.863244 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:58.863730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:58.864161 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:58.864849 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:58.865295 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:58.865714 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:58.929630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:04:58.937296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1228822d-7f46-48e0-8c53-eb39959575d8 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1217 microversion: 2.1 time: 0.086159 Sep 14 20:04:58.937878 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 518/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:58 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:04:59.961323 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:04:59.961976 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:04:59.969628 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:59.970138 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:59.970577 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:04:59.971266 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:04:59.971832 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:04:59.972255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:00.035900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:00.043557 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-167e7b8d-7e19-4e28-89de-ed93d197e3c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1265 microversion: 2.1 time: 0.086419 Sep 14 20:05:00.044107 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 544/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:04:59 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:01.067533 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:01.068909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:01.076652 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:01.084088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:01.084088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:01.084088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:01.084088 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:01.084619 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:01.215147 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:01.223524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2383b29b-8ec9-431c-a30e-c9de527ee58c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.160880 Sep 14 20:05:01.224098 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 519/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:01 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:01.898117 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-89a3d26a-e177-4f41-aa7f-fabed679212e req-e49a1c5e-2b0e-472a-a2e6-f99a27864574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e509cef8-58bd-430f-80cf-36e5a55cdc11", "tag": "64a8f2f7-a9fe-451d-b0c8-7f5e5bb2f6e1"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:01.908830 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-89a3d26a-e177-4f41-aa7f-fabed679212e req-e49a1c5e-2b0e-472a-a2e6-f99a27864574 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:01.909313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-89a3d26a-e177-4f41-aa7f-fabed679212e req-e49a1c5e-2b0e-472a-a2e6-f99a27864574 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:01.909748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-89a3d26a-e177-4f41-aa7f-fabed679212e req-e49a1c5e-2b0e-472a-a2e6-f99a27864574 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:01.921096 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-89a3d26a-e177-4f41-aa7f-fabed679212e req-e49a1c5e-2b0e-472a-a2e6-f99a27864574 service nova] Creating event network-changed:64a8f2f7-a9fe-451d-b0c8-7f5e5bb2f6e1 for instance e509cef8-58bd-430f-80cf-36e5a55cdc11 on hv-cinder-83976 Sep 14 20:05:01.926004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-89a3d26a-e177-4f41-aa7f-fabed679212e req-e49a1c5e-2b0e-472a-a2e6-f99a27864574 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031498 Sep 14 20:05:01.926598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 545/1064] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:02.247558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:02.248305 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:02.255400 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:02.255824 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:02.256258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:02.256949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:02.257397 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:02.257835 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:02.400465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:02.409151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-cd3b6ae8-88c4-4d7d-8f36-0f646800bf6c tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.166384 Sep 14 20:05:02.422023 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 520/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:02 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:03.432959 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:03.433651 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:03.440995 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:03.441479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:03.441932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:03.442622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:03.443075 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:03.443496 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:03.576242 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:03.584653 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c7308432-205a-4308-80ee-9be6b85100c6 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.156347 Sep 14 20:05:03.585239 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 546/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:03 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:04.608296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:04.609580 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:04.615979 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:04.616462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:04.616897 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:04.617581 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:04.618060 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:04.618488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:04.746486 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:04.754045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2fc9815d-4431-452d-901a-81a7b9ae8021 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.149717 Sep 14 20:05:04.754595 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 521/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:04 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:05.777319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:05.777960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:05.784957 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:05.785440 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:05.785904 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:05.786591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:05.787044 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:05.787467 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:05.913585 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:05.921975 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-26b1b2ad-14b3-4dd2-99be-aa7709cc2b1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.147954 Sep 14 20:05:05.922741 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 547/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:05 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:06.944774 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:06.945422 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:06.951821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:06.952307 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:06.952749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:06.953441 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:06.953922 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:06.954350 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:07.082993 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:07.090959 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-18af10b4-4312-4998-83a7-04b4192f287f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.150145 Sep 14 20:05:07.091532 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 522/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:06 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:08.104977 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-20887318-3c38-4e48-b426-0ca960ce56a8 req-52920d91-41c7-4d83-8c47-bdd50b64b9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e509cef8-58bd-430f-80cf-36e5a55cdc11", "name": "network-vif-plugged", "status": "completed", "tag": "64a8f2f7-a9fe-451d-b0c8-7f5e5bb2f6e1"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:08.110634 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:08.114357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:08.114973 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:08.115816 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-20887318-3c38-4e48-b426-0ca960ce56a8 req-52920d91-41c7-4d83-8c47-bdd50b64b9c8 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:08.116296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-20887318-3c38-4e48-b426-0ca960ce56a8 req-52920d91-41c7-4d83-8c47-bdd50b64b9c8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:08.116811 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-20887318-3c38-4e48-b426-0ca960ce56a8 req-52920d91-41c7-4d83-8c47-bdd50b64b9c8 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:08.117939 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:08.118597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=6 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:08.122607 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:08.123091 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:08.123523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:08.124705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:08.125155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:08.125611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:08.128088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-20887318-3c38-4e48-b426-0ca960ce56a8 req-52920d91-41c7-4d83-8c47-bdd50b64b9c8 service nova] Creating event network-vif-plugged:64a8f2f7-a9fe-451d-b0c8-7f5e5bb2f6e1 for instance e509cef8-58bd-430f-80cf-36e5a55cdc11 on hv-cinder-83976 Sep 14 20:05:08.132991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-20887318-3c38-4e48-b426-0ca960ce56a8 req-52920d91-41c7-4d83-8c47-bdd50b64b9c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031705 Sep 14 20:05:08.133569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 548/1070] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:08.267223 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:08.275368 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-40bbb2a3-3d0b-48ec-a2fc-7570c47c7d1a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.165028 Sep 14 20:05:08.275949 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 523/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:08 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:09.299201 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:09.299893 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:09.306614 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:09.307094 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:09.307525 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:09.308207 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:09.308654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:09.309076 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:09.440287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:09.447925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5fa39958-ccec-4920-a756-bfdc2aa67a85 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1313 microversion: 2.1 time: 0.153411 Sep 14 20:05:09.448481 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 549/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:09 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:10.472510 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:10.473117 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:10.479407 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:10.479887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:10.480321 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:10.481000 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:10.481449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:10.481909 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:10.611031 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:10.618739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-17ee2987-2b43-4667-b0f1-e58c6736d775 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1497 microversion: 2.1 time: 0.151028 Sep 14 20:05:10.619335 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 524/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:10 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:11.505791 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:11.506317 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:11.521000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:11.521479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:11.521986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:11.522655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:11.523099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:11.529062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:11.551777 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Going to try to terminate instance {{(pid=132861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:05:11.855944 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-d74f29fa-b311-46f0-8376-42fbaaa96e02 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 204 len: 0 microversion: 2.1 time: 0.358156 Sep 14 20:05:11.856709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 550/1074] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:05:11 2022] DELETE /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:05:11.864866 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:11.865476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:11.872149 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:11.872632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:11.873069 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:11.873759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:11.874729 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:11.875150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:12.004848 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:12.012587 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-23c267c1-c0b8-4c78-a327-b7460c7903b7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1503 microversion: 2.1 time: 0.151542 Sep 14 20:05:12.013178 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 525/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:11 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:13.036405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:13.037139 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:13.043522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:13.044034 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:13.044472 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:13.045164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:13.045653 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:13.046636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:13.179681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:13.188057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-32397c6e-0190-4eb4-b12b-3caea61fb8f0 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1503 microversion: 2.1 time: 0.156070 Sep 14 20:05:13.188619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 551/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:13 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:14.211543 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:14.212056 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:14.218698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:14.219177 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:14.219609 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:14.220314 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:14.220764 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:14.221184 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:14.355254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:14.363352 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-17485c2d-b648-4e0c-aa6d-69325aa2f9ee tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1503 microversion: 2.1 time: 0.155722 Sep 14 20:05:14.364123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 526/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:14 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:14.726082 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-cc74fc2d-5ef7-4805-9231-6c2684683150 req-7f7483ea-607f-4ea7-8077-68a714758c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e509cef8-58bd-430f-80cf-36e5a55cdc11", "name": "network-vif-deleted", "tag": "64a8f2f7-a9fe-451d-b0c8-7f5e5bb2f6e1"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:14.738282 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-cc74fc2d-5ef7-4805-9231-6c2684683150 req-7f7483ea-607f-4ea7-8077-68a714758c78 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:14.738857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-cc74fc2d-5ef7-4805-9231-6c2684683150 req-7f7483ea-607f-4ea7-8077-68a714758c78 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:14.739286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-cc74fc2d-5ef7-4805-9231-6c2684683150 req-7f7483ea-607f-4ea7-8077-68a714758c78 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:14.754899 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-cc74fc2d-5ef7-4805-9231-6c2684683150 req-7f7483ea-607f-4ea7-8077-68a714758c78 service nova] Creating event network-vif-deleted:64a8f2f7-a9fe-451d-b0c8-7f5e5bb2f6e1 for instance e509cef8-58bd-430f-80cf-36e5a55cdc11 on hv-cinder-83976 Sep 14 20:05:14.759683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-cc74fc2d-5ef7-4805-9231-6c2684683150 req-7f7483ea-607f-4ea7-8077-68a714758c78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037566 Sep 14 20:05:14.760261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 552/1078] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:15.387003 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:15.387611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:15.394576 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:15.395064 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:15.395499 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:15.396189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:15.396644 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:15.397067 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:15.457478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:15.465487 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4f0c5898-0579-4f4e-94a3-7109d4bddd7e tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1298 microversion: 2.1 time: 0.082350 Sep 14 20:05:15.466089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 527/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:15 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:16.489731 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:16.490522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:16.496804 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:16.497294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:16.497732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:16.498450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:16.499411 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:16.500003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:16.531064 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:16.531546 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:16.531983 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:16.532428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lazy-loading 'fault' on Instance uuid e509cef8-58bd-430f-80cf-36e5a55cdc11 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:05:16.573083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:16.581384 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ca290e6f-0390-4c12-85b1-bc8e3bff5742 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 200 len: 1303 microversion: 2.1 time: 0.096524 Sep 14 20:05:16.581973 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 553/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:16 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:17.604377 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:17.605024 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: e509cef8-58bd-430f-80cf-36e5a55cdc11] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:17.612027 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:17.612514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:17.612951 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:17.613638 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:17.614126 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:17.614556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:17.628509 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] HTTP exception thrown: Instance e509cef8-58bd-430f-80cf-36e5a55cdc11 could not be found. Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Request method failure captured: Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 HTTP/1.1 Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjPn-QHTHoMrxjP-J4epo3CddvPl7JhbFCtBkF5Ky-J8ue2UMSBxCW-NUPeaWQVsK5w0M4mSHudCze-exhjq80-De2mXfa_8ERMDkCYKJ4N9S5nkFTvmsHdQEf4Lc9BuAQakydBH3411_ozEhSwNl8bfa85_63dSqSNY_R82ePLgKSY Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: b9d4ae2217ce4378aca743ebba32e7d6 Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-VolumesActionsTest-929952875 Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:05:17.630181 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9d4ae2217ce4378aca743ebba32e7d6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9d4ae2217ce4378aca743ebba32e7d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9d4ae2217ce4378aca743ebba32e7d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9d4ae2217ce4378aca743ebba32e7d6"}]}] Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-VolumesActionsTest-929952875 Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: b9d4ae2217ce4378aca743ebba32e7d6 Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-VolumesActionsTest-929952875 Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-VolumesActionsTest-929952875-project Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: e763756287b04471bbc6b4f8afd28b8b Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-VolumesActionsTest-929952875-project Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance e509cef8-58bd-430f-80cf-36e5a55cdc11 could not be found. Sep 14 20:05:17.631879 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'e509cef8-58bd-430f-80cf-36e5a55cdc11'} Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e509cef8-58bd-430f-80cf-36e5a55cdc11 could not be found. Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:05:17.632875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e509cef8-58bd-430f-80cf-36e5a55cdc11 could not be found. Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e509cef8-58bd-430f-80cf-36e5a55cdc11 could not be found. Sep 14 20:05:17.634465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:05:17.636322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Returning 404 to user: Instance e509cef8-58bd-430f-80cf-36e5a55cdc11 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:05:17.636322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-76a8fd3a-bbf8-4d64-b907-8d4987550ec7 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11" status: 404 len: 111 microversion: 2.1 time: 0.031038 Sep 14 20:05:17.636322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 528/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:17 2022] GET /compute/v2.1/servers/e509cef8-58bd-430f-80cf-36e5a55cdc11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:05:17.680497 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-630077562", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452", "networks": [{"uuid": "edee15a4-e8db-4f3c-a785-fcf2a2690f68"}]}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:17.734686 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] validate_networks() for [('edee15a4-e8db-4f3c-a785-fcf2a2690f68', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:05:18.076432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:05:18.076850 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:05:18.077322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:05:18.078395 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:05:18.078817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:05:18.087825 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:18.091979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:18.091979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:18.091979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:18.091979 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:18.092586 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:18.106946 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Getting quotas for project b9d4ae2217ce4378aca743ebba32e7d6. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:05:18.111522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Getting quotas for user e763756287b04471bbc6b4f8afd28b8b and project b9d4ae2217ce4378aca743ebba32e7d6. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:05:18.126290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:05:18.126290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:05:18.222828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-08ac2408-711f-432c-8d5d-c01531abeb8f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546121 Sep 14 20:05:18.223463 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 554/1082] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:05:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:05:18.235097 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-30055c2d-7a9c-4673-b09f-36c0fbe373c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:18.235815 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-30055c2d-7a9c-4673-b09f-36c0fbe373c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:18.288044 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-30055c2d-7a9c-4673-b09f-36c0fbe373c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:18.294881 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-30055c2d-7a9c-4673-b09f-36c0fbe373c5 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1213 microversion: 2.1 time: 0.064308 Sep 14 20:05:18.295437 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 529/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:18 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:19.318767 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:19.319414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:19.326043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:19.326528 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:19.326964 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:19.328270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:19.328729 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:19.329155 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:19.389232 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:19.397495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-89fd1173-66c8-4463-bd75-f46601e7da3b tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1217 microversion: 2.1 time: 0.083081 Sep 14 20:05:19.398086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 555/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:19 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:20.420304 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:20.420915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:20.429327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:20.429829 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:20.430273 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:20.430967 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:20.431418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:20.431844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:20.497874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:20.505971 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c703a017-9c26-4ac3-a9b3-56c35a3b42ca tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1273 microversion: 2.1 time: 0.089547 Sep 14 20:05:20.507226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 530/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:20 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:05:21.539279 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:21.539910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:21.545952 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:21.550296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:21.550296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:21.550296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:21.550296 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:21.550687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:21.673626 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:21.681264 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-69470de7-d2c8-4c3a-a96f-29b51d0e5933 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.146027 Sep 14 20:05:21.681841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 556/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:21 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:22.518043 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-3fe64585-e6b1-4612-87ce-c37655835de2 req-0eada11c-da7a-4d7c-b04e-93d0dcb4c703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d89e9f-8e05-47a4-a899-f71aa822e42c", "tag": "9c68e07e-5e61-4abb-bedf-b58cc7f7706e"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:22.528258 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3fe64585-e6b1-4612-87ce-c37655835de2 req-0eada11c-da7a-4d7c-b04e-93d0dcb4c703 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:22.528759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3fe64585-e6b1-4612-87ce-c37655835de2 req-0eada11c-da7a-4d7c-b04e-93d0dcb4c703 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:22.529190 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-3fe64585-e6b1-4612-87ce-c37655835de2 req-0eada11c-da7a-4d7c-b04e-93d0dcb4c703 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:22.540623 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-3fe64585-e6b1-4612-87ce-c37655835de2 req-0eada11c-da7a-4d7c-b04e-93d0dcb4c703 service nova] Creating event network-changed:9c68e07e-5e61-4abb-bedf-b58cc7f7706e for instance b8d89e9f-8e05-47a4-a899-f71aa822e42c on hv-cinder-83976 Sep 14 20:05:22.546017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-3fe64585-e6b1-4612-87ce-c37655835de2 req-0eada11c-da7a-4d7c-b04e-93d0dcb4c703 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032637 Sep 14 20:05:22.546628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 531/1087] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:22.705063 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:22.706315 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:22.712428 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:22.713036 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:22.714018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:22.714810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:22.715363 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:22.715902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:22.919284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:22.928499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ed3f7841-0615-4765-82ad-49cd3734b193 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.228031 Sep 14 20:05:22.929252 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 557/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:22 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:23.952603 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:23.953296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:23.959844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:23.960323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:23.960758 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:23.961440 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:23.961974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:23.962423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:24.098457 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:24.106371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-714c68a8-a2b2-4401-a6ef-3e6d5e683410 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.157902 Sep 14 20:05:24.106930 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 532/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:23 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:25.129269 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:25.129903 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:25.136328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:25.136806 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:25.137240 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:25.137960 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:25.138418 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:25.138906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:25.269652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:25.277432 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0f5810e4-09be-4196-ae74-54b853e6cb64 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.152712 Sep 14 20:05:25.278057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 558/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:25 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:26.300738 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:26.309605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:26.309605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:26.309605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:26.309605 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:26.310057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:26.310151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:26.310568 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:26.338423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-978157910", "imageRef": "ad45b847-a81f-4588-a652-8cc56f52c130", "flavorRef": "452"}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:26.395431 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] validate_networks() for None {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:05:26.461201 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:26.466133 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d834b8c7-a100-4e51-9ca4-b1bbf32908b1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.169604 Sep 14 20:05:26.466690 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 533/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:26 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:26.674098 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:05:26.674522 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:05:26.674993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:05:26.675400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:05:26.675810 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:05:26.684434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:26.684915 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:26.685345 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:26.686097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:26.686554 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:26.687062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:26.703848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Getting quotas for project 327e2fb394ee4ebb882480bf59965576. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:05:26.707602 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Getting quotas for user 61f042c6fe40457ea80e0a107adedbd3 and project 327e2fb394ee4ebb882480bf59965576. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:05:26.719531 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:05:26.721641 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ad45b847-a81f-4588-a652-8cc56f52c130',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:05:26.842902 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-0f1fe3fc-7733-471c-9374-5e96d25ee241 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508584 Sep 14 20:05:26.844185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 559/1092] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 20:05:26.855366 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d725158f-d819-4b82-98f6-4c3a446fbb5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:26.856263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d725158f-d819-4b82-98f6-4c3a446fbb5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:26.910671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d725158f-d819-4b82-98f6-4c3a446fbb5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:26.917566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d725158f-d819-4b82-98f6-4c3a446fbb5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1214 microversion: 2.1 time: 0.066125 Sep 14 20:05:26.918179 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 534/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:26 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:27.488882 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:27.489474 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:27.505307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:27.505307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:27.505307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:27.505307 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:27.505779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:27.505779 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:27.628227 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:27.635867 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e02095d1-bf08-47c5-8092-4ce829631d2a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.151324 Sep 14 20:05:27.636430 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 560/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:27 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:27.941355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:27.942058 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:27.944488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:27.950919 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:27.951481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:27.951919 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:27.952611 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:27.953061 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:27.953495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:27.956149 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=85 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:28.018903 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:28.026302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c018a23a-8666-4c28-9c13-0346818c580d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1218 microversion: 2.1 time: 0.089571 Sep 14 20:05:28.026852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 535/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:27 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:28.345593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-60381720-1208-490d-8a28-742a3a0c9c70 req-e1e7f5a3-43ad-4770-8ffc-0a997d0d6268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d89e9f-8e05-47a4-a899-f71aa822e42c", "name": "network-vif-plugged", "status": "completed", "tag": "9c68e07e-5e61-4abb-bedf-b58cc7f7706e"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:28.355579 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:28.361737 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-60381720-1208-490d-8a28-742a3a0c9c70 req-e1e7f5a3-43ad-4770-8ffc-0a997d0d6268 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:28.365683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-60381720-1208-490d-8a28-742a3a0c9c70 req-e1e7f5a3-43ad-4770-8ffc-0a997d0d6268 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:28.365683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-60381720-1208-490d-8a28-742a3a0c9c70 req-e1e7f5a3-43ad-4770-8ffc-0a997d0d6268 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:28.365683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:28.374393 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-60381720-1208-490d-8a28-742a3a0c9c70 req-e1e7f5a3-43ad-4770-8ffc-0a997d0d6268 service nova] Creating event network-vif-plugged:9c68e07e-5e61-4abb-bedf-b58cc7f7706e for instance b8d89e9f-8e05-47a4-a899-f71aa822e42c on hv-cinder-83976 Sep 14 20:05:28.379337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-60381720-1208-490d-8a28-742a3a0c9c70 req-e1e7f5a3-43ad-4770-8ffc-0a997d0d6268 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038743 Sep 14 20:05:28.379908 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 561/1096] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:28.660121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:28.661171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:28.667432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:28.667956 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:28.675290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:28.675290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:28.675290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:28.675290 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:28.811512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:28.819248 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fc078783-7796-439f-857e-51a7b27bf54a tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.164232 Sep 14 20:05:28.819803 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 536/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:28 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:29.050749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:29.051451 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:29.058309 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:29.058796 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:29.059241 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:29.059963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:29.060421 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:29.060851 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:29.122358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:29.130160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-306ed5dd-e715-47e4-9096-5b28744579b1 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1266 microversion: 2.1 time: 0.084732 Sep 14 20:05:29.130750 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 562/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:29 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:29.842597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:29.843215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:29.850301 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:29.850793 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:29.851257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:29.852008 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:29.852464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:29.852947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:29.989236 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:29.998634 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-38bacb90-9370-4324-8df7-657732561d1f tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1313 microversion: 2.1 time: 0.160121 Sep 14 20:05:29.999210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 537/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:29 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:30.157433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:30.158088 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:30.164964 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:30.165446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:30.165906 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:30.166594 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:30.167043 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:30.167469 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:30.230392 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:30.238132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-3cd15466-6c71-4e94-8253-2dac4ad79187 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1284 microversion: 2.1 time: 0.085992 Sep 14 20:05:30.238704 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 563/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:30 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:31.021941 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:31.022524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:31.028987 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:31.030078 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:31.030078 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:31.030724 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:31.031171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:31.031591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:31.164038 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:31.171773 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e6b25b15-c670-4dba-af53-5984f8bc3130 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1497 microversion: 2.1 time: 0.153845 Sep 14 20:05:31.172348 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 538/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:31 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:31.260767 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:31.261376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:31.267811 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:31.268288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:31.268718 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:31.269398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:31.269879 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:31.270298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:31.404747 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:31.412965 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f886da91-5938-4ad4-9845-0bb4386f6755 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.156005 Sep 14 20:05:31.413532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 564/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:31 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:31.820323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-9648bd93-d92b-4115-9284-bcca85446959 req-3be72834-5a69-4cd3-9233-84e64c862e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a", "tag": "9b6f9ca8-8e4b-4c62-bfc9-97eb4a0f94c0"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:31.830337 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9648bd93-d92b-4115-9284-bcca85446959 req-3be72834-5a69-4cd3-9233-84e64c862e48 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:31.830915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9648bd93-d92b-4115-9284-bcca85446959 req-3be72834-5a69-4cd3-9233-84e64c862e48 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:31.831339 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-9648bd93-d92b-4115-9284-bcca85446959 req-3be72834-5a69-4cd3-9233-84e64c862e48 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:31.842496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-9648bd93-d92b-4115-9284-bcca85446959 req-3be72834-5a69-4cd3-9233-84e64c862e48 service nova] Creating event network-changed:9b6f9ca8-8e4b-4c62-bfc9-97eb4a0f94c0 for instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a on hv-cinder-83976 Sep 14 20:05:31.848081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-9648bd93-d92b-4115-9284-bcca85446959 req-3be72834-5a69-4cd3-9233-84e64c862e48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031510 Sep 14 20:05:31.848937 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 539/1103] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:32.160049 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:32.160576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:32.167151 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:32.167622 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:32.168062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:32.168753 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:32.169204 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:32.169629 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:32.195523 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Going to try to terminate instance {{(pid=132861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:05:32.437220 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:32.437842 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:32.444515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:32.445000 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:32.445432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:32.446151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:32.446640 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:32.447062 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:32.576367 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:32.584564 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-6c796e8d-8e7c-4fd6-a60c-33755d70beed tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.151748 Sep 14 20:05:32.585129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 540/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:32 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:05:32.618853 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-275bbebe-e81c-4c84-b1dd-b94dfbb2e8d1 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 204 len: 0 microversion: 2.1 time: 0.462956 Sep 14 20:05:32.619436 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 565/1105] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:05:32 2022] DELETE /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:05:32.627594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:32.628217 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:32.634140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:32.634727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:32.635173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:32.635870 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:32.636328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:32.636756 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:32.766160 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:32.774415 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4d36fde2-61a9-4b00-8912-bcca9c359fc4 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1503 microversion: 2.1 time: 0.150775 Sep 14 20:05:32.774981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 541/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:32 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:33.608925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:33.609650 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:33.616685 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:33.617160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:33.617593 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:33.618304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:33.618758 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:33.619183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:33.750157 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:33.757763 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-74a3cd3b-a8ed-4698-9588-91f501488614 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.153058 Sep 14 20:05:33.758354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 566/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:33 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:33.796349 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:33.796961 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:33.804108 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:33.804588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:33.805021 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:33.805698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:33.806171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:33.806590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:33.933899 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:33.941603 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fc609f32-6222-435b-9176-d2b581899268 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1503 microversion: 2.1 time: 0.149092 Sep 14 20:05:33.942194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 542/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:33 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:34.780601 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:34.781137 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:34.788162 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:34.788645 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:34.789085 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:34.789774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:34.790258 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:34.790682 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:34.965209 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:34.966622 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:34.973328 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:34.973847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:34.974284 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:34.974982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:34.975429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:34.975854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:35.013010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:35.023545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-14f93bc0-0459-4da5-aded-4c63d17c3e28 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.246819 Sep 14 20:05:35.024354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 567/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:34 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:35.109662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:35.117372 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e73d25c7-3686-4c63-abbf-a9ebaac05163 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1503 microversion: 2.1 time: 0.156319 Sep 14 20:05:35.117960 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 543/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:34 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:05:35.363398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-04e150ca-78dd-44ad-b32e-483b08568e57 req-ad8abb43-0f8a-4215-99bd-7e37b3c4d9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d89e9f-8e05-47a4-a899-f71aa822e42c", "name": "network-vif-deleted", "tag": "9c68e07e-5e61-4abb-bedf-b58cc7f7706e"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:35.372828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-04e150ca-78dd-44ad-b32e-483b08568e57 req-ad8abb43-0f8a-4215-99bd-7e37b3c4d9bb service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:35.373298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-04e150ca-78dd-44ad-b32e-483b08568e57 req-ad8abb43-0f8a-4215-99bd-7e37b3c4d9bb service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:35.373744 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-04e150ca-78dd-44ad-b32e-483b08568e57 req-ad8abb43-0f8a-4215-99bd-7e37b3c4d9bb service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:35.384527 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-04e150ca-78dd-44ad-b32e-483b08568e57 req-ad8abb43-0f8a-4215-99bd-7e37b3c4d9bb service nova] Creating event network-vif-deleted:9c68e07e-5e61-4abb-bedf-b58cc7f7706e for instance b8d89e9f-8e05-47a4-a899-f71aa822e42c on hv-cinder-83976 Sep 14 20:05:35.389310 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-04e150ca-78dd-44ad-b32e-483b08568e57 req-ad8abb43-0f8a-4215-99bd-7e37b3c4d9bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Sep 14 20:05:35.389943 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 568/1111] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:36.046102 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:36.046711 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:36.053507 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:36.054030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:36.054466 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:36.055151 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:36.055603 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:36.056030 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:36.141482 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:36.142203 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:36.148697 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:36.149183 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:36.149620 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:36.150371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:36.150818 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:36.151233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:36.183479 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:36.184221 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:36.184822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:36.185265 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lazy-loading 'fault' on Instance uuid b8d89e9f-8e05-47a4-a899-f71aa822e42c {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:05:36.192053 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:36.216958 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8fa60f8b-ec64-4d02-b386-06b5c8b689c9 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.174519 Sep 14 20:05:36.217550 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 544/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:36 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:36.232278 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e763756287b04471bbc6b4f8afd28b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d4ae2217ce4378aca743ebba32e7d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:36.239182 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7c45cc7d-8aeb-452c-96ac-a02f9de66e04 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 200 len: 1303 microversion: 2.1 time: 0.102288 Sep 14 20:05:36.239905 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 569/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:36 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:37.239779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:37.240316 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:37.242362 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=4 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:37.247661 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:37.248152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:37.248597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:37.252846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:37.252846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:37.252846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:37.263897 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:37.264505 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] [instance: b8d89e9f-8e05-47a4-a899-f71aa822e42c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:37.266457 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=4 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:37.267693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=12 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:37.272759 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:37.273244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:37.273683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:37.274412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:37.274864 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:37.275292 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:37.288659 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] HTTP exception thrown: Instance b8d89e9f-8e05-47a4-a899-f71aa822e42c could not be found. Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Request method failure captured: Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c HTTP/1.1 Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjPn-QHTHoMrxjP-J4epo3CddvPl7JhbFCtBkF5Ky-J8ue2UMSBxCW-NUPeaWQVsK5w0M4mSHudCze-exhjq80-De2mXfa_8ERMDkCYKJ4N9S5nkFTvmsHdQEf4Lc9BuAQakydBH3411_ozEhSwNl8bfa85_63dSqSNY_R82ePLgKSY Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: b9d4ae2217ce4378aca743ebba32e7d6 Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-VolumesActionsTest-929952875 Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:05:37.290358 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9d4ae2217ce4378aca743ebba32e7d6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9d4ae2217ce4378aca743ebba32e7d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9d4ae2217ce4378aca743ebba32e7d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9d4ae2217ce4378aca743ebba32e7d6"}]}] Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-VolumesActionsTest-929952875 Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: b9d4ae2217ce4378aca743ebba32e7d6 Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-VolumesActionsTest-929952875 Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-VolumesActionsTest-929952875-project Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: e763756287b04471bbc6b4f8afd28b8b Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-VolumesActionsTest-929952875-project Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance b8d89e9f-8e05-47a4-a899-f71aa822e42c could not be found. Sep 14 20:05:37.292010 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'b8d89e9f-8e05-47a4-a899-f71aa822e42c'} Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d89e9f-8e05-47a4-a899-f71aa822e42c could not be found. Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:05:37.293414 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d89e9f-8e05-47a4-a899-f71aa822e42c could not be found. Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d89e9f-8e05-47a4-a899-f71aa822e42c could not be found. Sep 14 20:05:37.294930 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:37.296072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] Returning 404 to user: Instance b8d89e9f-8e05-47a4-a899-f71aa822e42c could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:05:37.296072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-10ad829b-519a-4813-849d-b512415794f9 tempest-VolumesActionsTest-929952875 tempest-VolumesActionsTest-929952875-project] 10.222.0.42 "GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c" status: 404 len: 111 microversion: 2.1 time: 0.031784 Sep 14 20:05:37.296072 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 570/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:37 2022] GET /compute/v2.1/servers/b8d89e9f-8e05-47a4-a899-f71aa822e42c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 20:05:37.383848 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:37.391506 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-80fa513f-b2f7-4708-a740-dd43915a4785 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.155640 Sep 14 20:05:37.392728 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 545/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:37 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:38.366046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-6bde0714-ae47-47bf-94dd-6360d8b6ab2c req-febe64d6-d0d9-449a-a9ab-fadcd85a8796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a", "name": "network-vif-plugged", "status": "completed", "tag": "9b6f9ca8-8e4b-4c62-bfc9-97eb4a0f94c0"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:38.376265 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-6bde0714-ae47-47bf-94dd-6360d8b6ab2c req-febe64d6-d0d9-449a-a9ab-fadcd85a8796 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:38.376756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-6bde0714-ae47-47bf-94dd-6360d8b6ab2c req-febe64d6-d0d9-449a-a9ab-fadcd85a8796 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:38.377179 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-6bde0714-ae47-47bf-94dd-6360d8b6ab2c req-febe64d6-d0d9-449a-a9ab-fadcd85a8796 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:38.387987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-6bde0714-ae47-47bf-94dd-6360d8b6ab2c req-febe64d6-d0d9-449a-a9ab-fadcd85a8796 service nova] Creating event network-vif-plugged:9b6f9ca8-8e4b-4c62-bfc9-97eb4a0f94c0 for instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a on hv-cinder-83976 Sep 14 20:05:38.393127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-6bde0714-ae47-47bf-94dd-6360d8b6ab2c req-febe64d6-d0d9-449a-a9ab-fadcd85a8796 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Sep 14 20:05:38.393677 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 571/1116] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:38.414694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:38.415925 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:38.422512 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:38.423004 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:38.423480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:38.424173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:38.424627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:38.425187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:38.572196 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:38.580419 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e5f27444-7dae-4b38-af31-49bfcfec2ec2 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.168947 Sep 14 20:05:38.580974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 546/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:38 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:39.605405 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:39.606128 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:39.612939 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:39.613413 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:39.613881 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:39.614564 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:39.615013 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:39.615434 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:39.894718 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:39.902238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-aef2a685-a233-432b-934e-4466889660e0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.301483 Sep 14 20:05:39.902819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 572/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:39 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:40.925858 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:40.926478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:40.932464 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:40.932948 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:40.933387 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:40.934100 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:40.934559 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:40.934985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:41.063475 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:41.071140 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-eebd6815-b25d-4cd2-bcc0-c8a41912dac0 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.149899 Sep 14 20:05:41.071705 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 547/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:40 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:42.093914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:42.094518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:42.100903 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:42.101375 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:42.101805 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:42.102501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:42.102949 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:42.103369 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:42.229433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:42.237062 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-963da25a-bad6-4ffe-8b27-a7ce37d7b703 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1314 microversion: 2.1 time: 0.147027 Sep 14 20:05:42.238145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 573/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:42 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:43.263471 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:43.265319 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:43.275839 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:43.276609 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:43.277212 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:43.278123 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:43.278583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:43.279011 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:43.435920 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:43.445847 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7364bd5c-c44a-49c3-8c8f-a00c62550b5b tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1462 microversion: 2.1 time: 0.188957 Sep 14 20:05:43.446797 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 548/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:43 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1462 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:43.498709 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:43.499516 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:43.507068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:43.507854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:43.508501 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:43.509257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:43.509926 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:43.510621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:43.539180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Going to try to terminate instance {{(pid=132861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:05:43.896523 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ea350fd5-1828-44b3-b3dc-cc366d15486d tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 204 len: 0 microversion: 2.1 time: 0.403309 Sep 14 20:05:43.900294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 574/1122] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:05:43 2022] DELETE /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:05:43.905579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:43.906300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:43.914981 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:43.915478 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:43.915918 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:43.916645 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:43.917127 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:43.917523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:44.137357 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:44.146229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-2176e3a8-cd65-446d-a48e-e66efafc715a tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1468 microversion: 2.1 time: 0.244756 Sep 14 20:05:44.147064 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 549/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:43 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1468 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:45.172020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:45.172856 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:45.180322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:45.181146 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:45.181880 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:45.182869 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:45.183619 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:45.184158 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:45.339997 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:45.349055 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-286ba7b7-dde9-4f84-8202-b03d3ccc3fea tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1468 microversion: 2.1 time: 0.181704 Sep 14 20:05:45.349648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 575/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:45 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1468 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:46.354771 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-c0841728-33d5-4bb9-870b-ff49cf37c2fc req-ab8c9134-e082-4836-95e0-857b021e8dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a", "name": "network-vif-deleted", "tag": "9b6f9ca8-8e4b-4c62-bfc9-97eb4a0f94c0"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:46.370293 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-c0841728-33d5-4bb9-870b-ff49cf37c2fc req-ab8c9134-e082-4836-95e0-857b021e8dac service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:46.371141 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-c0841728-33d5-4bb9-870b-ff49cf37c2fc req-ab8c9134-e082-4836-95e0-857b021e8dac service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:46.371874 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-c0841728-33d5-4bb9-870b-ff49cf37c2fc req-ab8c9134-e082-4836-95e0-857b021e8dac service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:46.374053 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:46.374667 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:46.385518 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:46.386055 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:46.387566 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-c0841728-33d5-4bb9-870b-ff49cf37c2fc req-ab8c9134-e082-4836-95e0-857b021e8dac service nova] Creating event network-vif-deleted:9b6f9ca8-8e4b-4c62-bfc9-97eb4a0f94c0 for instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a on hv-cinder-83976 Sep 14 20:05:46.388021 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:46.388800 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:46.389257 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:46.389681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:46.402111 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-c0841728-33d5-4bb9-870b-ff49cf37c2fc req-ab8c9134-e082-4836-95e0-857b021e8dac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050891 Sep 14 20:05:46.405982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 550/1125] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:05:46.494288 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:46.500744 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:46.504231 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-bb230f50-0ee4-4706-8639-ed786bdbf1bf tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1426 microversion: 2.1 time: 0.135032 Sep 14 20:05:46.518417 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 576/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:46 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1426 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:47.530338 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:47.536664 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:47.538630 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:47.539112 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:47.539737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:47.540616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:47.541224 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:47.541845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:47.580707 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:47.581727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:47.582171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:47.582822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lazy-loading 'fault' on Instance uuid 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:05:47.627285 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f042c6fe40457ea80e0a107adedbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e2fb394ee4ebb882480bf59965576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:47.638470 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-be63b392-f554-4785-a142-bf0155020bd4 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 200 len: 1304 microversion: 2.1 time: 0.111901 Sep 14 20:05:47.639941 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 551/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:47 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:05:48.664143 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:48.664761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] [instance: 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:48.671917 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:48.672545 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:48.672993 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:48.673705 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:48.674199 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:48.674632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:48.692654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] HTTP exception thrown: Instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a could not be found. Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Request method failure captured: Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a HTTP/1.1 Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjQEmrDKw5WfPfWEw8_d-6Ihhb5SMEGnAdNPKDPsuFdxRMkmzbzgWEkJdK7FzEn7pMSwfY6JjtQ0SwsKWJuJdm4ShMU1o67GzK6JbWO4pbxubvyAxYOImGYI41ueBS3Sl6YfWNs0OfmJGX9mj8FQ1dd_o_MZPIzc7fxwchGSTK1R4Oo Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 327e2fb394ee4ebb882480bf59965576 Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-VolumesNegativeTest-1267628877 Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:05:48.717127 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_327e2fb394ee4ebb882480bf59965576", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/327e2fb394ee4ebb882480bf59965576"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/327e2fb394ee4ebb882480bf59965576"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/327e2fb394ee4ebb882480bf59965576"}]}] Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-VolumesNegativeTest-1267628877 Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 327e2fb394ee4ebb882480bf59965576 Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-VolumesNegativeTest-1267628877 Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-VolumesNegativeTest-1267628877-project Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 61f042c6fe40457ea80e0a107adedbd3 Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-VolumesNegativeTest-1267628877-project Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a could not be found. Sep 14 20:05:48.720004 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': '5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a'} Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a could not be found. Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:05:48.721216 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a could not be found. Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a could not be found. Sep 14 20:05:48.723693 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:05:48.725610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] Returning 404 to user: Instance 5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:05:48.725610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ee878c7a-486a-45b7-9a9e-36760d863f97 tempest-VolumesNegativeTest-1267628877 tempest-VolumesNegativeTest-1267628877-project] 10.222.0.42 "GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a" status: 404 len: 111 microversion: 2.1 time: 0.036768 Sep 14 20:05:48.725610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 577/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:48 2022] GET /compute/v2.1/servers/5eb0a52d-8928-401c-bd7b-e56e9e9f7b8a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:05:58.475830 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:58.476508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:58.479905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:05:58.480118 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Wed Sep 14 20:05:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c (ip 10.222.0.42) !!! Sep 14 20:05:58.481616 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=35 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:58.484785 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=95 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:05:58.499361 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:58.499988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:58.500538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:58.501495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:58.502220 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:58.503579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:58.506227 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-3f0472e2-33c2-437e-976c-386289934103 req-f39b36a9-5099-47a2-aef2-dfdbeccf0ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16963b9-9ad4-4a98-b1bc-eeca734dab8c", "tag": "ef0f455b-8116-43f0-96ef-d2554406ee03"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:05:58.528175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-3f0472e2-33c2-437e-976c-386289934103 req-f39b36a9-5099-47a2-aef2-dfdbeccf0ddb service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:58.528670 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-3f0472e2-33c2-437e-976c-386289934103 req-f39b36a9-5099-47a2-aef2-dfdbeccf0ddb service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:58.529111 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-3f0472e2-33c2-437e-976c-386289934103 req-f39b36a9-5099-47a2-aef2-dfdbeccf0ddb service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:58.533203 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:05:58.548303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-3f0472e2-33c2-437e-976c-386289934103 req-f39b36a9-5099-47a2-aef2-dfdbeccf0ddb service nova] Creating event network-changed:ef0f455b-8116-43f0-96ef-d2554406ee03 for instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c on hv-cinder-83976 Sep 14 20:05:58.562603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-3f0472e2-33c2-437e-976c-386289934103 req-f39b36a9-5099-47a2-aef2-dfdbeccf0ddb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062465 Sep 14 20:05:58.564028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 578/1129] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:05:58.887739 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-506c8a61-2eb3-483a-8c19-73dd60b7e1aa tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 204 len: 0 microversion: 2.1 time: 0.415523 Sep 14 20:05:58.888699 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 552/1130] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:05:58 2022] DELETE /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:05:58.898155 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:05:58.902238 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:05:58.911804 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:58.912299 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:58.912739 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:58.913446 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:05:58.913955 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:05:58.914392 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:05:59.070478 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:05:59.078582 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a5a016ea-1fef-48ed-bf78-83903e9a1256 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.185276 Sep 14 20:05:59.079181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 579/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:05:58 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:00.103257 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:00.103953 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:00.110297 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:00.110778 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:00.111208 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:00.111893 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:00.113243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:00.113243 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:00.248430 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:00.256465 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-fc2c8ce3-2a52-41f9-b17b-d7a869d64c07 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1570 microversion: 2.1 time: 0.157217 Sep 14 20:06:00.256945 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 553/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:00 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:01.202119 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-65ff4fc5-b4fe-409a-a218-14b4589f7630 req-de0dbe94-8fea-4602-9fbe-fe085d4873a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16963b9-9ad4-4a98-b1bc-eeca734dab8c", "name": "network-vif-deleted", "tag": "ef0f455b-8116-43f0-96ef-d2554406ee03"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:06:01.207429 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:01.212681 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-65ff4fc5-b4fe-409a-a218-14b4589f7630 req-de0dbe94-8fea-4602-9fbe-fe085d4873a2 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:01.213161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-65ff4fc5-b4fe-409a-a218-14b4589f7630 req-de0dbe94-8fea-4602-9fbe-fe085d4873a2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:01.213588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-65ff4fc5-b4fe-409a-a218-14b4589f7630 req-de0dbe94-8fea-4602-9fbe-fe085d4873a2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:01.225440 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-65ff4fc5-b4fe-409a-a218-14b4589f7630 req-de0dbe94-8fea-4602-9fbe-fe085d4873a2 service nova] Creating event network-vif-deleted:ef0f455b-8116-43f0-96ef-d2554406ee03 for instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c on hv-cinder-83976 Sep 14 20:06:01.230211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-65ff4fc5-b4fe-409a-a218-14b4589f7630 req-de0dbe94-8fea-4602-9fbe-fe085d4873a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032116 Sep 14 20:06:01.230790 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 580/1133] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:06:01.280727 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:01.281378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:01.288938 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:01.289433 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:01.289902 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:01.290603 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:01.291057 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:01.291480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:01.357734 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:01.366241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-58fcfdb6-186c-469f-ac3d-dea1e55a6275 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1383 microversion: 2.1 time: 0.089358 Sep 14 20:06:01.366754 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 554/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:01 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1383 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:02.391233 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:02.391947 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:02.398673 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:02.399159 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:02.399597 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:02.400294 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:02.400746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:02.401170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:02.439276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:02.439276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:02.439276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:02.439276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lazy-loading 'fault' on Instance uuid a16963b9-9ad4-4a98-b1bc-eeca734dab8c {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:06:02.480187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04af0db8835d427092c076d35b3e67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5c2273800e43a096bce8807c31fbf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:02.487844 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-ebe6a48a-0a12-4d18-8e73-62a7b89ad2e5 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 200 len: 1225 microversion: 2.1 time: 0.101446 Sep 14 20:06:02.488962 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 581/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:02 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:03.511952 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:03.512488 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] [instance: a16963b9-9ad4-4a98-b1bc-eeca734dab8c] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:03.519571 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:03.520550 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:03.520982 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:03.521724 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:03.522378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:03.522799 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:03.536431 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] HTTP exception thrown: Instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c could not be found. Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Request method failure captured: Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c HTTP/1.1 Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjLsHVpTwtM26TpHD2mvttmcZSmAutWM2fAg6ml-ydkQAndanBZt6BHaID3Ol4qHf4J0TRNJRA30yzfEqLas1EtcjzU64RG_RZD6Tch7-AoTzdpLmPzpWngGJZmgQzVLF86BV_ajWOJ2lsv7zyXdbz97nqEsgbG8stxIv0rvZKfclFg Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 2d5c2273800e43a096bce8807c31fbf5 Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-TestShelveInstance-1215335838 Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:06:03.538106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d5c2273800e43a096bce8807c31fbf5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d5c2273800e43a096bce8807c31fbf5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d5c2273800e43a096bce8807c31fbf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d5c2273800e43a096bce8807c31fbf5"}]}] Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-TestShelveInstance-1215335838 Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 2d5c2273800e43a096bce8807c31fbf5 Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-TestShelveInstance-1215335838 Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-TestShelveInstance-1215335838-project Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 04af0db8835d427092c076d35b3e67d9 Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-TestShelveInstance-1215335838-project Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c could not be found. Sep 14 20:06:03.539867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'a16963b9-9ad4-4a98-b1bc-eeca734dab8c'} Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c could not be found. Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:06:03.544105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c could not be found. Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c could not be found. Sep 14 20:06:03.546137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:06:03.547572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Returning 404 to user: Instance a16963b9-9ad4-4a98-b1bc-eeca734dab8c could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:06:03.547572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a4ee13d3-37e4-46b5-8022-5886cbe8d91a tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c" status: 404 len: 111 microversion: 2.1 time: 0.031579 Sep 14 20:06:03.547572 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 555/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:03 2022] GET /compute/v2.1/servers/a16963b9-9ad4-4a98-b1bc-eeca734dab8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:06:03.790275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-fccde301-f733-498c-ad81-7d11c40b4545 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] Calling method '.version_select at 0x7f19e8e67820>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:03.900126 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-fccde301-f733-498c-ad81-7d11c40b4545 tempest-TestShelveInstance-1215335838 tempest-TestShelveInstance-1215335838-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1022979039" status: 202 len: 0 microversion: 2.1 time: 0.114585 Sep 14 20:06:03.903471 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 582/1137] 10.222.0.42 () {58 vars in 1254 bytes} [Wed Sep 14 20:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1022979039 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 20:06:18.774846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:18.775590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:18.941717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a0e55b11-9074-418f-9a8e-6439d14212f2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Action: 'create', calling method: .version_select at 0x7f19e5411940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-542401345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5MacOPHKK4h390AgC9uksOU6wL0dqHk26mY2uH5FScNS/EdTwPbBTj+x2Vum6yecjNBuNDk7Cy0nuxObwGIOBRsB4opLGRBgZX7ziNcOZCEYGAJdkUe4b7NLaR765yIQ=="}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:06:18.959323 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-a0e55b11-9074-418f-9a8e-6439d14212f2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for project 22037e56af1445c3a88064031d7d4254. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:06:18.963493 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-a0e55b11-9074-418f-9a8e-6439d14212f2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for user 35e2c522107f4744b8357889a07595eb and project 22037e56af1445c3a88064031d7d4254. Resources: {'key_pairs'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:06:19.052096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a0e55b11-9074-418f-9a8e-6439d14212f2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.282326 Sep 14 20:06:19.052704 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 556/1138] 10.222.0.42 () {60 vars in 1159 bytes} [Wed Sep 14 20:06:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:06:39.939473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=21 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:39.940205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:39.944125 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1478324770", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-542401345", "security_groups": [{"name": "tempest-secgroup-smoke-233198925"}], "block_device_mapping_v2": [{"uuid": "8d900a32-903c-45e8-9788-871b8ac4bcc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1f2762c-9f2c-40ed-9fcc-a81e354b6034"}]}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:06:40.055845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] validate_networks() for [('a1f2762c-9f2c-40ed-9fcc-a81e354b6034', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:06:40.512287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:06:40.512738 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:06:40.513221 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:06:40.513636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:06:40.514086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:06:40.522878 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:40.523366 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:40.523830 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:40.524590 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:40.525046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:40.525474 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:40.543046 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for project 22037e56af1445c3a88064031d7d4254. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:06:40.546991 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for user 35e2c522107f4744b8357889a07595eb and project 22037e56af1445c3a88064031d7d4254. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:06:40.605512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:06:40.607643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d900a32-903c-45e8-9788-871b8ac4bcc1',volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:06:41.063078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-b0ad7d5b-c316-48c6-a51b-62f3a97485db tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.125183 Sep 14 20:06:41.063713 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 583/1139] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:06:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:06:41.074195 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=4 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:41.078862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-dfe33d97-1629-4d73-9ee5-2a0605bd779a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:41.079481 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-dfe33d97-1629-4d73-9ee5-2a0605bd779a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:41.136416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-dfe33d97-1629-4d73-9ee5-2a0605bd779a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:41.143353 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-dfe33d97-1629-4d73-9ee5-2a0605bd779a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1094 microversion: 2.1 time: 0.071069 Sep 14 20:06:41.143925 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 557/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:41 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:42.167763 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-af03a372-cff8-42b7-bdc7-5ad1022d5012 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:42.168377 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-af03a372-cff8-42b7-bdc7-5ad1022d5012 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:42.224980 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-af03a372-cff8-42b7-bdc7-5ad1022d5012 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:42.232038 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-af03a372-cff8-42b7-bdc7-5ad1022d5012 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1094 microversion: 2.1 time: 0.069442 Sep 14 20:06:42.232603 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 584/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:42 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:43.254274 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:43.254883 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:43.261742 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:43.262189 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:43.262674 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:43.263360 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:43.263809 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:43.264228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:43.324425 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:43.332034 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b4d48e5d-56be-4f93-adc5-2ade77a1d17c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1192 microversion: 2.1 time: 0.081614 Sep 14 20:06:43.332580 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 558/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:43 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:44.355524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:44.356223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:44.363172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:44.363737 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:44.364236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:44.365184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:44.365702 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:44.366243 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:44.513576 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:44.521495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-adc3de87-df3a-4415-b7cf-fd7636caa72e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1277 microversion: 2.1 time: 0.170116 Sep 14 20:06:44.533978 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 585/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:44 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:45.342761 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-2d7e85cf-a82f-4cb6-bf21-32471fbc82f4 req-5303c9da-a5e3-42c4-8dc1-ffe196c511d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff22969d-30fb-4694-9760-258964775fec", "tag": "dd0cc6cd-d313-41ab-9806-04fce027b9f4"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:06:45.352442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2d7e85cf-a82f-4cb6-bf21-32471fbc82f4 req-5303c9da-a5e3-42c4-8dc1-ffe196c511d2 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:45.352990 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2d7e85cf-a82f-4cb6-bf21-32471fbc82f4 req-5303c9da-a5e3-42c4-8dc1-ffe196c511d2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:45.353496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-2d7e85cf-a82f-4cb6-bf21-32471fbc82f4 req-5303c9da-a5e3-42c4-8dc1-ffe196c511d2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:45.367356 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-2d7e85cf-a82f-4cb6-bf21-32471fbc82f4 req-5303c9da-a5e3-42c4-8dc1-ffe196c511d2 service nova] Creating event network-changed:dd0cc6cd-d313-41ab-9806-04fce027b9f4 for instance ff22969d-30fb-4694-9760-258964775fec on hv-cinder-83976 Sep 14 20:06:45.372947 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-2d7e85cf-a82f-4cb6-bf21-32471fbc82f4 req-5303c9da-a5e3-42c4-8dc1-ffe196c511d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090151 Sep 14 20:06:45.373548 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 559/1144] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:06:45.544532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:45.545145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:45.551512 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:45.551996 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:45.552433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:45.553123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:45.553575 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:45.554028 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:45.773422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:45.781045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-a5a76a64-c627-4483-a71c-80c932b0e1da tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.240510 Sep 14 20:06:45.781610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 586/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:45 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:46.804105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:46.804804 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:46.811554 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:46.812041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:46.812480 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:46.813173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:46.813628 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:46.814083 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:46.948845 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:46.956515 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e4f7eb6a-d606-4991-9f0f-3ff43be85984 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.156611 Sep 14 20:06:46.957103 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 560/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:46 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:47.980562 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:47.981316 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:47.987978 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:47.988456 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:47.988886 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:47.989567 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:47.990179 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:47.990598 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:48.127941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:48.127941 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c47cbcd5-47c4-46bc-b523-0822d45e8025 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.151959 Sep 14 20:06:48.128380 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 587/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:47 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:49.150972 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:49.151543 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:49.158050 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:49.158537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:49.158977 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:49.159663 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:49.160116 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:49.160541 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:49.297160 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:49.304875 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-73e6c29f-212e-4b6f-be66-8456e19f25f3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.157871 Sep 14 20:06:49.305440 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 561/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:49 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:50.327744 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:50.328357 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:50.334809 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:50.335285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:50.335712 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:50.336386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:50.336838 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:50.337256 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:50.466493 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:50.474079 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-91fb7bcc-32bd-4d0d-9b13-4f930970e44f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.150800 Sep 14 20:06:50.475748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 588/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:50 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:51.496720 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:51.497327 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:51.499871 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:51.504786 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:51.505259 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:51.505696 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:51.506397 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:51.506843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:51.507261 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:51.640757 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:51.648521 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-4e6bf034-44cf-40f7-8285-98e5d3682ed4 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.155728 Sep 14 20:06:51.649089 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 562/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:51 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:52.670305 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:52.670914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:52.672732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:52.673424 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=8 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:06:52.678175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:52.678652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:52.679086 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:52.679767 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:52.680218 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:52.680637 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:52.806014 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:52.813566 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-209b2171-86d3-4a4c-9247-9d148fcec75a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.147282 Sep 14 20:06:52.814161 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 589/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:52 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:53.836682 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:53.837300 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:53.844542 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:53.845028 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:53.845462 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:53.846346 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:53.846805 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:53.847228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:53.976309 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:53.984582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-79e5c1d2-9b28-416d-8b7a-a62f1502f75b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.151882 Sep 14 20:06:53.985143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 563/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:53 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:55.007186 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:55.007829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:55.014196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:55.014674 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:55.015153 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:55.015788 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:55.016274 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:55.016643 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:55.148606 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:55.156608 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-30a25b68-c178-485e-9eb7-e6036eba0184 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.153239 Sep 14 20:06:55.157185 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 590/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:55 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:56.179434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:56.179980 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:56.186997 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:56.187482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:56.187922 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:56.188612 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:56.189068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:56.189496 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:56.315637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:56.323242 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f134566c-7622-4b24-9ce6-7da56563ace7 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.147788 Sep 14 20:06:56.324396 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 564/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:56 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:56.929538 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-9db69293-ecaa-4f2f-a8c0-d6beee534d38 req-e3bb9754-da3b-4076-9b81-770e5a484d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff22969d-30fb-4694-9760-258964775fec", "name": "network-vif-plugged", "status": "completed", "tag": "dd0cc6cd-d313-41ab-9806-04fce027b9f4"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:06:56.938860 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9db69293-ecaa-4f2f-a8c0-d6beee534d38 req-e3bb9754-da3b-4076-9b81-770e5a484d47 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:56.939327 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9db69293-ecaa-4f2f-a8c0-d6beee534d38 req-e3bb9754-da3b-4076-9b81-770e5a484d47 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:56.939748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-9db69293-ecaa-4f2f-a8c0-d6beee534d38 req-e3bb9754-da3b-4076-9b81-770e5a484d47 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:56.950596 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-9db69293-ecaa-4f2f-a8c0-d6beee534d38 req-e3bb9754-da3b-4076-9b81-770e5a484d47 service nova] Creating event network-vif-plugged:dd0cc6cd-d313-41ab-9806-04fce027b9f4 for instance ff22969d-30fb-4694-9760-258964775fec on hv-cinder-83976 Sep 14 20:06:56.956009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-9db69293-ecaa-4f2f-a8c0-d6beee534d38 req-e3bb9754-da3b-4076-9b81-770e5a484d47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088637 Sep 14 20:06:56.956368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 591/1155] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:06:57.346742 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:57.347355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:57.353746 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:57.354254 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:57.354688 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:57.355404 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:57.355851 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:57.356271 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:57.492584 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:57.500188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b2986116-26c0-45b1-a178-a1f3faadb18f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.157256 Sep 14 20:06:57.500751 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 565/1156] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:57 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:58.524401 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:58.525020 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:58.531657 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:58.533019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:58.533019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:58.533364 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:58.533671 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:58.534123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:58.672654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:58.681200 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cbe70a98-95d7-4a24-a68c-18cae9dad38f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1265 microversion: 2.1 time: 0.161535 Sep 14 20:06:58.682066 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 592/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:58 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:59.704429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:59.705045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:59.711528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:59.712010 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:59.712447 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:59.713134 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:59.713588 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:59.714040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:59.841218 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:06:59.848844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-62c408ba-6484-4dd9-9e5b-0124c55cad77 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1451 microversion: 2.1 time: 0.148302 Sep 14 20:06:59.849404 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 566/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:59 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:06:59.871184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:06:59.871793 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:06:59.878277 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:59.878755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:59.879186 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:06:59.879889 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:06:59.880341 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:06:59.880759 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:07:00.006390 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:07:00.014082 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-285e84f1-b166-4815-b7a5-338723de1a1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1451 microversion: 2.1 time: 0.146759 Sep 14 20:07:00.014652 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 593/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:06:59 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:07:01.874958 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-06cc749f-c0b4-4b85-9643-c42eee2c7dd8 req-173d8899-32f5-402e-aab8-0374e2810dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff22969d-30fb-4694-9760-258964775fec", "tag": "dd0cc6cd-d313-41ab-9806-04fce027b9f4"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:07:01.885448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-06cc749f-c0b4-4b85-9643-c42eee2c7dd8 req-173d8899-32f5-402e-aab8-0374e2810dc9 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:07:01.889131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-06cc749f-c0b4-4b85-9643-c42eee2c7dd8 req-173d8899-32f5-402e-aab8-0374e2810dc9 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:07:01.889131 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-06cc749f-c0b4-4b85-9643-c42eee2c7dd8 req-173d8899-32f5-402e-aab8-0374e2810dc9 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:07:01.899983 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-06cc749f-c0b4-4b85-9643-c42eee2c7dd8 req-173d8899-32f5-402e-aab8-0374e2810dc9 service nova] Creating event network-changed:dd0cc6cd-d313-41ab-9806-04fce027b9f4 for instance ff22969d-30fb-4694-9760-258964775fec on hv-cinder-83976 Sep 14 20:07:01.905819 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-06cc749f-c0b4-4b85-9643-c42eee2c7dd8 req-173d8899-32f5-402e-aab8-0374e2810dc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034636 Sep 14 20:07:01.906840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 567/1160] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:08:59.343857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fc735e88-2a53-4aac-9fb7-7b164f0fdbcb] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 20:08:59.344683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:59.345424 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=52 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:59.346909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 20:08:59.347051 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Wed Sep 14 20:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec (ip 10.222.0.42) !!! Sep 14 20:08:59.351378 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:08:59.351873 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:08:59.358740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:08:59.363925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:08:59.363925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:08:59.363925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:08:59.363925 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:08:59.364442 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:08:59.388112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Going to try to terminate instance {{(pid=132861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:08:59.626806 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-81d5d3e6-1b41-4221-9049-dee3d24b0574 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 204 len: 0 microversion: 2.1 time: 0.284765 Sep 14 20:08:59.627318 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 594/1161] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:08:59 2022] DELETE /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:08:59.634365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c12d6ab-bf19-4fea-809b-b20989ae0980] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 20:08:59.642556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:59.642556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=52 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:08:59.642556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:08:59.642556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Wed Sep 14 20:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec (ip 10.222.0.42) !!! Sep 14 20:08:59.642556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 20:08:59.642556 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Wed Sep 14 20:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec (ip 10.222.0.42) !!! Sep 14 20:08:59.643852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:08:59.645137 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:08:59.653844 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:08:59.654331 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:08:59.654765 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:08:59.655476 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:08:59.655931 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:08:59.656354 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:08:59.792918 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:08:59.801508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-bc858984-8307-42fe-96dd-47c6f30b2803 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1576 microversion: 2.1 time: 0.168487 Sep 14 20:08:59.802105 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 568/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:08:59 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:00.825205 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:00.825947 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:00.834045 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:00.834527 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:00.834961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:00.835657 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:00.836108 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:00.836532 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:00.842027 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO oslo.messaging._drivers.impl_rabbit [-] [fc735e88-2a53-4aac-9fb7-7b164f0fdbcb] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 60136. Sep 14 20:09:00.966211 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:00.974666 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c01cd47f-2ed1-414d-93ca-3157b2722747 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1576 microversion: 2.1 time: 0.153705 Sep 14 20:09:00.975223 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 595/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:00 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:01.997321 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:01.997963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:02.008737 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c12d6ab-bf19-4fea-809b-b20989ae0980] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 60140. Sep 14 20:09:02.013852 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:02.014341 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:02.014776 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:02.015467 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:02.015915 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:02.016334 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:02.185313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:02.185313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b4a65279-3a11-4be1-acff-a322bb2a2591 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1576 microversion: 2.1 time: 0.168213 Sep 14 20:09:02.185313 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 569/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:01 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:02.404914 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-b093562a-9a01-4604-8bb9-416846cf2a54 req-94272b34-22c5-4453-bb4d-6ad643a94875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff22969d-30fb-4694-9760-258964775fec", "name": "network-vif-deleted", "tag": "dd0cc6cd-d313-41ab-9806-04fce027b9f4"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:09:02.415121 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b093562a-9a01-4604-8bb9-416846cf2a54 req-94272b34-22c5-4453-bb4d-6ad643a94875 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:02.420060 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b093562a-9a01-4604-8bb9-416846cf2a54 req-94272b34-22c5-4453-bb4d-6ad643a94875 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:02.420060 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-b093562a-9a01-4604-8bb9-416846cf2a54 req-94272b34-22c5-4453-bb4d-6ad643a94875 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:02.427849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-b093562a-9a01-4604-8bb9-416846cf2a54 req-94272b34-22c5-4453-bb4d-6ad643a94875 service nova] Creating event network-vif-deleted:dd0cc6cd-d313-41ab-9806-04fce027b9f4 for instance ff22969d-30fb-4694-9760-258964775fec on hv-cinder-83976 Sep 14 20:09:02.432686 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-b093562a-9a01-4604-8bb9-416846cf2a54 req-94272b34-22c5-4453-bb4d-6ad643a94875 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Sep 14 20:09:02.433329 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 596/1165] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:09:03.184741 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:03.185423 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:03.192049 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:03.192540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:03.192975 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:03.193679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:03.194167 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:03.194591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:03.228380 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:03.228671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:03.229106 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:03.229558 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.objects.instance [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lazy-loading 'fault' on Instance uuid ff22969d-30fb-4694-9760-258964775fec {{(pid=132862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:09:03.274152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:03.283096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-06a07b7f-297b-4f2d-84d9-c42fc0364a55 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 200 len: 1230 microversion: 2.1 time: 0.102356 Sep 14 20:09:03.283782 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 570/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:03 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:04.308181 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:04.308868 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:04.315000 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:04.315477 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:04.315910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:04.316583 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:04.317026 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:04.317499 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:04.332483 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] HTTP exception thrown: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Request method failure captured: Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec HTTP/1.1 Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjQzsugM4qYiCjUIcmzJsGsdl6_CkBTwlZb1nNTP60-ox_RPWeOQLEX29ArnxJo5s8NYp7UuCLAn6M8JBNte5W4nHxelZUAMm_ys5tOBqyQUnjBy9CcilSEZ2XHdjKVPx65kUIoaW6_Nlh5aIuWHZB5BbLIvj2h7HOsSPo0sj2_-0Sc Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:09:04.334144 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_22037e56af1445c3a88064031d7d4254", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/22037e56af1445c3a88064031d7d4254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}] Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 35e2c522107f4744b8357889a07595eb Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:09:04.335967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'ff22969d-30fb-4694-9760-258964775fec'} Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:09:04.336987 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:09:04.338756 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:09:04.340290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Returning 404 to user: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:09:04.340290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e51fee6c-b8b6-41b1-8074-f3095b62834b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 404 len: 111 microversion: 2.1 time: 0.032009 Sep 14 20:09:04.340290 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 597/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:04 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 20:09:04.384324 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-82300045", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-542401345", "security_groups": [{"name": "tempest-secgroup-smoke-233198925"}], "block_device_mapping_v2": [{"uuid": "8d900a32-903c-45e8-9788-871b8ac4bcc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1f2762c-9f2c-40ed-9fcc-a81e354b6034"}]}} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:09:04.501014 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.network.neutron [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] validate_networks() for [('a1f2762c-9f2c-40ed-9fcc-a81e354b6034', None, None, None, None, None)] {{(pid=132862) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:09:04.928500 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Flavor limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:09:04.928927 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Image limits 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:09:04.929428 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Flavor pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:09:04.929859 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Image pref 0:0:0 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:09:04.930276 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.virt.hardware [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:09:04.938973 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:04.939453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:04.939905 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:04.940617 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:04.941108 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:04.941538 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:04.957887 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for project 22037e56af1445c3a88064031d7d4254. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:09:04.961848 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.quota [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for user 35e2c522107f4744b8357889a07595eb and project 22037e56af1445c3a88064031d7d4254. Resources: {'cores', 'instances', 'ram'} {{(pid=132862) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:09:05.017694 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Going to run 1 instances... {{(pid=132862) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:09:05.019921 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d900a32-903c-45e8-9788-871b8ac4bcc1',volume_size=None,volume_type=None)] {{(pid=132862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:09:05.418822 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-0986e5ec-d6a4-48de-b8aa-49aafa51f5d8 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.038163 Sep 14 20:09:05.419821 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 571/1168] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:09:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:09:05.430789 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-9a5c304c-3399-4458-b700-a238df8ec760 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:05.431328 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-9a5c304c-3399-4458-b700-a238df8ec760 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:05.485221 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-9a5c304c-3399-4458-b700-a238df8ec760 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:05.493121 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-9a5c304c-3399-4458-b700-a238df8ec760 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1092 microversion: 2.1 time: 0.066275 Sep 14 20:09:05.493691 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 598/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:05 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:06.516284 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:06.516893 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:06.523492 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:06.523969 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:06.524402 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:06.525084 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:06.525533 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:06.525990 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:06.591418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:06.599864 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f7ac9d2d-ab7c-4ef4-8f64-3e5edb6ac60d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1142 microversion: 2.1 time: 0.087466 Sep 14 20:09:06.600434 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 572/1170] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:06 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1142 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:07.624961 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:07.625579 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:07.633695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:07.634260 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:07.642164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:07.642164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:07.642164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:07.642164 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:07.709636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:07.717748 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7263fd4e-80e9-4278-be54-97bffb0dd5dd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1198 microversion: 2.1 time: 0.098360 Sep 14 20:09:07.718335 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 599/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:07 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:08.740577 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:08.741229 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:08.747569 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:08.748068 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:08.748532 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:08.749250 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:08.749745 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:08.750188 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:08.886461 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:08.894524 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-417082a0-673d-4ee3-9939-6dd5fe567d8b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1275 microversion: 2.1 time: 0.157883 Sep 14 20:09:08.896371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 573/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:08 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:09.335022 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-d70e3c4a-78c8-44eb-80e8-b3ce238e4b2d req-3b21f881-410a-407e-9a58-8d6c5ed5cc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33aecd2-362e-4c07-b17c-3fac08e6bf5e", "tag": "9f278e8e-27d2-4cfb-8a3e-fc9188a781fa"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:09:09.345172 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-d70e3c4a-78c8-44eb-80e8-b3ce238e4b2d req-3b21f881-410a-407e-9a58-8d6c5ed5cc25 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:09.345648 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-d70e3c4a-78c8-44eb-80e8-b3ce238e4b2d req-3b21f881-410a-407e-9a58-8d6c5ed5cc25 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:09.346109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-d70e3c4a-78c8-44eb-80e8-b3ce238e4b2d req-3b21f881-410a-407e-9a58-8d6c5ed5cc25 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:09.357833 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-d70e3c4a-78c8-44eb-80e8-b3ce238e4b2d req-3b21f881-410a-407e-9a58-8d6c5ed5cc25 service nova] Creating event network-changed:9f278e8e-27d2-4cfb-8a3e-fc9188a781fa for instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e on hv-cinder-83976 Sep 14 20:09:09.362734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-d70e3c4a-78c8-44eb-80e8-b3ce238e4b2d req-3b21f881-410a-407e-9a58-8d6c5ed5cc25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032861 Sep 14 20:09:09.363410 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 600/1173] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:09:09.917992 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:09.918601 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:09.925679 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:09.926205 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:09.926637 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:09.927318 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:09.927808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:09.928228 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:10.062754 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:10.070983 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e1a75384-d93a-4e3c-99dc-b176246de137 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.156903 Sep 14 20:09:10.071553 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 574/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:09 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:11.096553 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:11.097259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:11.104080 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:11.104559 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:11.104994 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:11.105679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:11.106165 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:11.106589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:11.235889 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:11.243525 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e238ffc7-f4c7-4e78-a4d7-8598b71603ca tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.151896 Sep 14 20:09:11.244083 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 601/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:11 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:12.265575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:12.266219 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:12.272622 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:12.273097 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:12.273528 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:12.274249 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:12.274698 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:12.275119 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:12.401195 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:12.408817 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-453ad330-2275-4e2d-8398-b2924ca38afe tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.147070 Sep 14 20:09:12.409574 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 575/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:12 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:13.431813 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:13.432444 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:13.438771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:13.439250 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:13.439676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:13.440354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:13.440798 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:13.441220 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:13.566841 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:13.574462 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-4c985d37-765c-4a4e-a39a-5040771bdd46 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.146460 Sep 14 20:09:13.575013 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 602/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:13 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:14.597680 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:14.598319 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:14.604736 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:14.605215 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:14.605648 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:14.606360 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:14.606809 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:14.607259 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:14.745272 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:14.747398 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-370333a9-596b-4aee-a9e5-a641a08c4ff2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.153604 Sep 14 20:09:14.747965 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 576/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:14 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:15.771657 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:15.772303 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:15.774703 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:15.779478 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:15.779950 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:15.780381 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:15.781058 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:15.781502 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:15.781951 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:15.912657 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:15.920285 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-87bef578-d1e3-4627-9cb5-dbcfb0fc31ee tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.153032 Sep 14 20:09:15.920839 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 603/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:15 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:16.942958 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:16.943580 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:16.945436 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:16.946124 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=6 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:09:16.951501 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:16.951992 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:16.952438 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:16.953135 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:16.953591 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:16.954079 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:17.085485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:17.093540 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-f0bded89-90db-455d-873a-1218b2836606 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.154559 Sep 14 20:09:17.094138 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 577/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:16 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:18.116679 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:18.117254 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:18.123616 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:18.124098 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:18.124524 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:18.125208 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:18.125655 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:18.126110 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:18.252798 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:18.260463 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-5efdb6b3-189a-4491-9974-cf855ced4ab2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.148311 Sep 14 20:09:18.261018 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 604/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:18 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:19.283548 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:19.284125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:19.290508 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:19.290988 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:19.291416 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:19.292092 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:19.292537 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:19.292955 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:19.429378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:19.437632 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e7dd4e73-d9fe-4f99-b3ec-a4aee5dbcabd tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.157984 Sep 14 20:09:19.438224 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 578/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:19 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:19.531368 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-14e577b8-ca37-40a1-b8fb-efaa490ecc28 req-f4f7734f-66f5-48b8-a25c-a6dbb4e47401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33aecd2-362e-4c07-b17c-3fac08e6bf5e", "name": "network-vif-plugged", "status": "completed", "tag": "9f278e8e-27d2-4cfb-8a3e-fc9188a781fa"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:09:19.541187 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-14e577b8-ca37-40a1-b8fb-efaa490ecc28 req-f4f7734f-66f5-48b8-a25c-a6dbb4e47401 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:19.541673 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-14e577b8-ca37-40a1-b8fb-efaa490ecc28 req-f4f7734f-66f5-48b8-a25c-a6dbb4e47401 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:19.542099 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-14e577b8-ca37-40a1-b8fb-efaa490ecc28 req-f4f7734f-66f5-48b8-a25c-a6dbb4e47401 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:19.555569 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-14e577b8-ca37-40a1-b8fb-efaa490ecc28 req-f4f7734f-66f5-48b8-a25c-a6dbb4e47401 service nova] Creating event network-vif-plugged:9f278e8e-27d2-4cfb-8a3e-fc9188a781fa for instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e on hv-cinder-83976 Sep 14 20:09:19.566901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-14e577b8-ca37-40a1-b8fb-efaa490ecc28 req-f4f7734f-66f5-48b8-a25c-a6dbb4e47401 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032906 Sep 14 20:09:19.566901 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 605/1183] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:09:20.461442 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:20.462052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:20.468669 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:20.469155 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:20.469593 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:20.470303 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:20.470760 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:20.471187 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:20.611974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:20.611974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-ca81810f-7539-45f7-ba31-a9ddafc47d37 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.152059 Sep 14 20:09:20.611974 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 579/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:20 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:21.633646 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:21.634485 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:21.640610 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:21.641123 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:21.641556 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:21.642284 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:21.642740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:21.643167 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:21.781876 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:21.791002 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-19d416fd-f075-4053-8d68-2813d1174265 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1263 microversion: 2.1 time: 0.162179 Sep 14 20:09:21.791751 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 606/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:21 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:22.813965 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:22.814579 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:22.820973 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:22.821448 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:22.821908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:22.822589 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:22.823036 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:22.823455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:22.957620 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:22.965405 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-06eb22d8-ea07-4649-bbf1-c2f66f9c771e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1449 microversion: 2.1 time: 0.155374 Sep 14 20:09:22.965984 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 580/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:22 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:22.987743 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:09:22.988351 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:09:22.995263 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:22.995740 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:22.996168 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:22.996849 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:22.997298 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:22.997716 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:23.123191 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:09:23.130939 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-012c16ab-d545-48d0-b57f-a69ae2bd2122 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1449 microversion: 2.1 time: 0.146919 Sep 14 20:09:23.131437 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 607/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:09:22 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:09:25.265662 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33aecd2-362e-4c07-b17c-3fac08e6bf5e", "tag": "9f278e8e-27d2-4cfb-8a3e-fc9188a781fa"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:09:25.276453 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:09:25.276838 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:09:25.277271 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:09:25.288658 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] Creating event network-changed:9f278e8e-27d2-4cfb-8a3e-fc9188a781fa for instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e on hv-cinder-83976 Sep 14 20:09:25.292768 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR oslo.messaging._drivers.impl_rabbit [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] [a525a24b-6eae-4626-b9e9-ef3d9fc5aaee] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 20:09:26.301268 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] [a525a24b-6eae-4626-b9e9-ef3d9fc5aaee] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 60228. Sep 14 20:09:26.305523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-d95aa141-3c66-4dba-b4b3-3a0b42f593c8 req-4107aca3-4da5-44d1-bf5b-f2664028bb45 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.044086 Sep 14 20:09:26.306171 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 581/1188] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:11:11.669481 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-303451225", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-542401345", "security_groups": [{"name": "tempest-secgroup-smoke-233198925"}], "block_device_mapping_v2": [{"uuid": "d70b88f8-c35a-48c5-b833-78686f8d7765", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1f2762c-9f2c-40ed-9fcc-a81e354b6034"}]}} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:11:11.679854 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:11:11.680587 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:11:11.681606 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:11:11.681772 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Wed Sep 14 20:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 14 20:11:11.882259 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.network.neutron [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] validate_networks() for [('a1f2762c-9f2c-40ed-9fcc-a81e354b6034', None, None, None, None, None)] {{(pid=132861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 20:11:12.245871 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Flavor limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 20:11:12.246304 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Image limits 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 20:11:12.246781 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Flavor pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 20:11:12.247190 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Image pref 0:0:0 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 20:11:12.247617 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.virt.hardware [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 20:11:12.256732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:12.262188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:12.262188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:12.262188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:12.262188 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:12.262599 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:12.276261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for project 22037e56af1445c3a88064031d7d4254. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 20:11:12.280870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.quota [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Getting quotas for user 35e2c522107f4744b8357889a07595eb and project 22037e56af1445c3a88064031d7d4254. Resources: {'cores', 'instances', 'ram'} {{(pid=132861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 20:11:12.335774 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Going to run 1 instances... {{(pid=132861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 20:11:12.337909 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d70b88f8-c35a-48c5-b833-78686f8d7765',volume_size=None,volume_type=None)] {{(pid=132861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 20:11:12.706180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-baab9ec5-000b-4e19-9db9-ea4c767a185a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.040897 Sep 14 20:11:12.706857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 608/1189] 10.222.0.42 () {60 vars in 1147 bytes} [Wed Sep 14 20:11:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 20:11:12.716444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c12d6ab-bf19-4fea-809b-b20989ae0980] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 20:11:12.716929 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:11:12.717671 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=78 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:11:12.723570 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1cb661e0-5f04-4470-8458-51aab72150d1 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:12.724282 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1cb661e0-5f04-4470-8458-51aab72150d1 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:12.836263 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1cb661e0-5f04-4470-8458-51aab72150d1 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:12.843452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1cb661e0-5f04-4470-8458-51aab72150d1 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1093 microversion: 2.1 time: 0.129067 Sep 14 20:11:12.844016 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 582/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:12 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1093 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:13.866992 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:13.867541 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:13.874376 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:13.875115 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:13.875270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:13.875950 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:13.876397 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:13.876816 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:13.936733 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:13.944461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e7b71b3d-3516-4dc4-8570-5df76015458f tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1143 microversion: 2.1 time: 0.082001 Sep 14 20:11:13.945015 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 609/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:13 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:14.968529 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:14.969143 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:14.987752 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:14.988253 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:14.988713 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:14.989421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:14.989901 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:14.990332 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:14.993772 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c12d6ab-bf19-4fea-809b-b20989ae0980] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 60322. Sep 14 20:11:15.057942 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:15.066865 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b11cb29f-c9d0-4256-a317-2f2bc85d6e0a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1209 microversion: 2.1 time: 0.102940 Sep 14 20:11:15.067472 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 583/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:14 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:16.090589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:16.091891 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:16.099263 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:16.099746 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:16.100176 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:16.100870 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:16.101313 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:16.101732 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:16.229370 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:16.237829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7c167de5-0c9c-46c5-bdea-c0c132ec2440 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1276 microversion: 2.1 time: 0.151679 Sep 14 20:11:16.238340 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 610/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:16 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:16.605386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-a9d592e1-eb35-4314-a7ef-5e361423ce1c req-c2ea9916-6468-42e7-9f1d-7a0e55db2e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd5f42d-a156-4ca3-b213-753bfc338fd0", "tag": "66becbdc-7204-4e03-ab12-714af057465d"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:11:16.615808 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a9d592e1-eb35-4314-a7ef-5e361423ce1c req-c2ea9916-6468-42e7-9f1d-7a0e55db2e24 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:16.616450 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a9d592e1-eb35-4314-a7ef-5e361423ce1c req-c2ea9916-6468-42e7-9f1d-7a0e55db2e24 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:16.616703 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-a9d592e1-eb35-4314-a7ef-5e361423ce1c req-c2ea9916-6468-42e7-9f1d-7a0e55db2e24 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:16.627554 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-a9d592e1-eb35-4314-a7ef-5e361423ce1c req-c2ea9916-6468-42e7-9f1d-7a0e55db2e24 service nova] Creating event network-changed:66becbdc-7204-4e03-ab12-714af057465d for instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 on hv-cinder-83976 Sep 14 20:11:16.632452 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-a9d592e1-eb35-4314-a7ef-5e361423ce1c req-c2ea9916-6468-42e7-9f1d-7a0e55db2e24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030804 Sep 14 20:11:16.633176 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 584/1194] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:11:17.260555 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:17.261170 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:17.268601 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:17.269244 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:17.269819 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:17.270533 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:17.270986 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:17.271412 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:17.651352 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:17.659108 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-e6ba976d-29a3-4fb6-b0be-d43514b6d9de tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.402523 Sep 14 20:11:17.659684 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 611/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:17 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:18.726634 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:18.727371 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:18.734121 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:18.734600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:18.735041 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:18.735724 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:18.736173 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:18.736597 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:18.866154 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:18.874429 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-d82db987-3f49-4e6c-9ddd-619370221b8d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.195546 Sep 14 20:11:18.874562 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 585/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:18 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:19.896423 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:19.897033 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:19.903422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:19.904398 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:19.904822 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:19.905500 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:19.905990 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:19.906406 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:20.033985 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:20.041726 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-7c302be7-f22e-4f9d-a900-7d13eb5b8b1a tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.149135 Sep 14 20:11:20.042422 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 612/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:19 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:21.065877 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:21.066495 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:21.073093 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:21.073575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:21.074045 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:21.074744 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:21.075200 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:21.075627 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:21.204984 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:21.212646 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-1cec5a70-f4a8-49e5-9b39-0735e6abf60b tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.150664 Sep 14 20:11:21.213210 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 586/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:21 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:22.235270 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:22.235827 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:22.242245 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:22.242734 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:22.243173 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:22.243863 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:22.244319 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:22.244745 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:22.267109 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=2 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:11:22.287132 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell0:SELECT=6 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:11:22.375255 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:22.382845 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f86a0008-94ff-41d0-97c3-397ed251efc6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.151632 Sep 14 20:11:22.383400 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 613/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:22 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:23.406824 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:23.407365 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:23.409840 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell0:SELECT=2 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:11:23.414596 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:23.415080 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:23.415514 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:23.416202 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:23.416656 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:23.417081 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:23.548275 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:23.555967 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-121de90e-4a3c-46b9-b9e2-5b48ae5b0aae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.153089 Sep 14 20:11:23.556539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 587/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:23 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:24.579864 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:24.580470 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:24.586829 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:24.587302 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:24.587755 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:24.588461 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:24.588911 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:24.589327 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:24.715749 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:24.723781 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-cacaa3ad-42bd-4611-a8f9-3e7fc92a91bf tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.148374 Sep 14 20:11:24.724337 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 614/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:24 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:25.746444 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:25.747052 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:25.753573 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:25.754150 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:25.754582 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:25.755265 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:25.755711 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:25.756129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:25.886204 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:25.894779 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-8b3da825-45dd-4889-9a4a-58a58c153c96 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.152055 Sep 14 20:11:25.895278 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 588/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:25 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:26.917013 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:26.917621 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:26.923992 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:26.924473 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:26.924910 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:26.925595 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:26.926068 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:26.926495 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:27.056009 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:27.064145 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c91a3815-4419-4543-8c06-39ba0a735e01 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.150988 Sep 14 20:11:27.064698 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 615/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:26 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:28.077401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-aeb4414d-d2fa-466c-b0be-f47fbbe6b4d1 req-42920d11-75dd-4e95-8f4c-43a1d5e23329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd5f42d-a156-4ca3-b213-753bfc338fd0", "name": "network-vif-plugged", "status": "completed", "tag": "66becbdc-7204-4e03-ab12-714af057465d"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:11:28.086523 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:28.087069 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:28.087643 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-aeb4414d-d2fa-466c-b0be-f47fbbe6b4d1 req-42920d11-75dd-4e95-8f4c-43a1d5e23329 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:28.088129 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-aeb4414d-d2fa-466c-b0be-f47fbbe6b4d1 req-42920d11-75dd-4e95-8f4c-43a1d5e23329 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:28.088594 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-aeb4414d-d2fa-466c-b0be-f47fbbe6b4d1 req-42920d11-75dd-4e95-8f4c-43a1d5e23329 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:28.094519 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:28.095003 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:28.095433 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:28.096115 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:28.096589 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:28.097008 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:28.100666 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-aeb4414d-d2fa-466c-b0be-f47fbbe6b4d1 req-42920d11-75dd-4e95-8f4c-43a1d5e23329 service nova] Creating event network-vif-plugged:66becbdc-7204-4e03-ab12-714af057465d for instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 on hv-cinder-83976 Sep 14 20:11:28.105553 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-aeb4414d-d2fa-466c-b0be-f47fbbe6b4d1 req-42920d11-75dd-4e95-8f4c-43a1d5e23329 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032334 Sep 14 20:11:28.106194 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 589/1204] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:11:28.231717 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:28.239771 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-f355a79b-260e-48b8-b321-e38d1835c558 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.157348 Sep 14 20:11:28.240350 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 616/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:28 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:11:29.264804 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:29.265505 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:29.271712 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:29.272198 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:29.272666 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:29.273355 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:29.273833 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:29.274266 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:29.407861 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:29.415485 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-33e241a5-5c78-4e59-9840-60d9c923f1c6 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1264 microversion: 2.1 time: 0.155941 Sep 14 20:11:29.416051 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 590/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:29 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:30.437932 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:30.438527 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:30.444631 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:30.445107 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:30.445536 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:30.446247 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:30.446695 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:30.447112 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:30.573321 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:30.581271 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-803e094b-9db3-448d-b3c7-69214a63b955 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1450 microversion: 2.1 time: 0.147260 Sep 14 20:11:30.581826 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 617/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:30 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:30.603854 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:11:30.604467 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:11:30.611383 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:30.611863 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:30.612292 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:30.612968 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:30.613421 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:30.613862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:30.740670 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:11:30.748346 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-7c214521-3b62-48ae-b025-a9ef1ee4580d tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1450 microversion: 2.1 time: 0.148317 Sep 14 20:11:30.748902 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 591/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:11:30 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:11:32.643921 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-c4791ac7-3675-4de0-9075-1c9368972464 req-5a514bd7-0499-461d-8898-bf1e1a667bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd5f42d-a156-4ca3-b213-753bfc338fd0", "tag": "66becbdc-7204-4e03-ab12-714af057465d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:11:32.653224 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c4791ac7-3675-4de0-9075-1c9368972464 req-5a514bd7-0499-461d-8898-bf1e1a667bc2 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:11:32.653922 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c4791ac7-3675-4de0-9075-1c9368972464 req-5a514bd7-0499-461d-8898-bf1e1a667bc2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:11:32.654348 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-c4791ac7-3675-4de0-9075-1c9368972464 req-5a514bd7-0499-461d-8898-bf1e1a667bc2 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:11:32.667331 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-c4791ac7-3675-4de0-9075-1c9368972464 req-5a514bd7-0499-461d-8898-bf1e1a667bc2 service nova] Creating event network-changed:66becbdc-7204-4e03-ab12-714af057465d for instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 on hv-cinder-83976 Sep 14 20:11:32.672676 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-c4791ac7-3675-4de0-9075-1c9368972464 req-5a514bd7-0499-461d-8898-bf1e1a667bc2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086977 Sep 14 20:11:32.673454 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 618/1209] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:13:12.713054 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_api:SELECT=22 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:13:12.716892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG dbcounter [-] [132862] Writing DB stats nova_cell1:SELECT=46 {{(pid=132862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:13:12.716892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:13:12.716892 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Wed Sep 14 20:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 (ip 10.222.0.42) !!! Sep 14 20:13:12.717196 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:13:12.717600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:13:12.717600 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Wed Sep 14 20:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 (ip 10.222.0.42) !!! Sep 14 20:13:12.719287 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG dbcounter [-] [132861] Writing DB stats nova_cell1:SELECT=58 {{(pid=132861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 20:13:12.720727 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 20:13:12.721005 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Wed Sep 14 20:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 14 20:13:12.721717 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:12.722255 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:12.731928 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:12.732418 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:12.732857 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:12.734026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:12.734026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:12.734447 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:12.742261 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [req-0a224f59-48a0-4d97-b341-9c99fb3d77aa req-a7c1d6a9-7133-4784-afc8-a7cd48c4a2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd5f42d-a156-4ca3-b213-753bfc338fd0", "tag": "66becbdc-7204-4e03-ab12-714af057465d"}]} {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:13:12.752967 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0a224f59-48a0-4d97-b341-9c99fb3d77aa req-a7c1d6a9-7133-4784-afc8-a7cd48c4a2a3 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:12.755612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0a224f59-48a0-4d97-b341-9c99fb3d77aa req-a7c1d6a9-7133-4784-afc8-a7cd48c4a2a3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:12.755612 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [req-0a224f59-48a0-4d97-b341-9c99fb3d77aa req-a7c1d6a9-7133-4784-afc8-a7cd48c4a2a3 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:12.763818 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Going to try to terminate instance {{(pid=132862) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:13:12.766042 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.compute.server_external_events [req-0a224f59-48a0-4d97-b341-9c99fb3d77aa req-a7c1d6a9-7133-4784-afc8-a7cd48c4a2a3 service nova] Creating event network-changed:66becbdc-7204-4e03-ab12-714af057465d for instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 on hv-cinder-83976 Sep 14 20:13:12.771460 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [req-0a224f59-48a0-4d97-b341-9c99fb3d77aa req-a7c1d6a9-7133-4784-afc8-a7cd48c4a2a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058346 Sep 14 20:13:12.772386 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 619/1210] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:13:13.129040 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-a14db069-9a86-4525-9356-aa465f2c1842 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 204 len: 0 microversion: 2.1 time: 0.418021 Sep 14 20:13:13.130191 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 592/1211] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:13:12 2022] DELETE /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:13:13.138178 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:13.139050 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:13.147055 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:13.147535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:13.148175 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:13.148649 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:13.149097 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:13.150052 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:13.298078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:13:13.305817 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-c2484820-00ab-4e75-bb05-43f53d034f34 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1574 microversion: 2.1 time: 0.171803 Sep 14 20:13:13.306374 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 620/1212] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:13 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 20:13:14.329762 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:14.330518 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:14.336923 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:14.337398 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:14.337846 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:14.338523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:14.338968 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:14.339384 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:14.474867 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:13:14.483386 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-89570899-1f90-4297-ab38-295bf4fc6ca3 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1574 microversion: 2.1 time: 0.157818 Sep 14 20:13:14.483954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 593/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:14 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:13:15.529714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:15.529714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:15.529714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:15.529714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:15.530687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:15.530687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:15.530687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:15.530687 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:15.585014 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:13:15.592966 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-171e7e92-0134-473f-9611-18ae142c82ae tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1389 microversion: 2.1 time: 0.089498 Sep 14 20:13:15.593535 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 621/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:15 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:13:15.639843 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-f532c5cf-f8a8-46bd-ac39-d6288ca9dfec req-e29ad3ba-17f3-44d8-9ed5-f9ea03a1c226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd5f42d-a156-4ca3-b213-753bfc338fd0", "name": "network-vif-deleted", "tag": "66becbdc-7204-4e03-ab12-714af057465d"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:13:15.650310 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f532c5cf-f8a8-46bd-ac39-d6288ca9dfec req-e29ad3ba-17f3-44d8-9ed5-f9ea03a1c226 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:15.662074 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f532c5cf-f8a8-46bd-ac39-d6288ca9dfec req-e29ad3ba-17f3-44d8-9ed5-f9ea03a1c226 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:15.662074 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-f532c5cf-f8a8-46bd-ac39-d6288ca9dfec req-e29ad3ba-17f3-44d8-9ed5-f9ea03a1c226 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:15.662326 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-f532c5cf-f8a8-46bd-ac39-d6288ca9dfec req-e29ad3ba-17f3-44d8-9ed5-f9ea03a1c226 service nova] Creating event network-vif-deleted:66becbdc-7204-4e03-ab12-714af057465d for instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 on hv-cinder-83976 Sep 14 20:13:15.667296 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-f532c5cf-f8a8-46bd-ac39-d6288ca9dfec req-e29ad3ba-17f3-44d8-9ed5-f9ea03a1c226 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112960 Sep 14 20:13:15.667908 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 594/1215] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:13:16.616361 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:16.616999 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:16.623448 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:16.623934 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:16.624371 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:16.625078 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:16.625533 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:16.625995 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:16.656683 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:16.657152 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:16.657588 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:16.658057 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.objects.instance [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lazy-loading 'fault' on Instance uuid 5cd5f42d-a156-4ca3-b213-753bfc338fd0 {{(pid=132861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 20:13:16.697041 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:13:16.704828 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1d43a3cc-d724-4d1d-8017-63a441107b1e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 200 len: 1229 microversion: 2.1 time: 0.092307 Sep 14 20:13:16.705388 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 622/1216] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:16 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:13:17.729963 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:17.730673 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: 5cd5f42d-a156-4ca3-b213-753bfc338fd0] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:17.737267 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:17.737749 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:17.738226 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:17.738913 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:17.739364 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:17.739788 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:17.752954 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] HTTP exception thrown: Instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 could not be found. Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Request method failure captured: Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 HTTP/1.1 Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjQzsugM4qYiCjUIcmzJsGsdl6_CkBTwlZb1nNTP60-ox_RPWeOQLEX29ArnxJo5s8NYp7UuCLAn6M8JBNte5W4nHxelZUAMm_ys5tOBqyQUnjBy9CcilSEZ2XHdjKVPx65kUIoaW6_Nlh5aIuWHZB5BbLIvj2h7HOsSPo0sj2_-0Sc Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:13:17.754590 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_22037e56af1445c3a88064031d7d4254", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/22037e56af1445c3a88064031d7d4254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}] Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 35e2c522107f4744b8357889a07595eb Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 could not be found. Sep 14 20:13:17.756378 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': '5cd5f42d-a156-4ca3-b213-753bfc338fd0'} Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 could not be found. Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:13:17.757401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 could not be found. Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 could not be found. Sep 14 20:13:17.759146 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:17.760759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Returning 404 to user: Instance 5cd5f42d-a156-4ca3-b213-753bfc338fd0 could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:13:17.760759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-b93a3e44-2ee1-4d43-b91c-a95d84cb0b6e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0" status: 404 len: 111 microversion: 2.1 time: 0.030900 Sep 14 20:13:17.760759 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 595/1217] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:17 2022] GET /compute/v2.1/servers/5cd5f42d-a156-4ca3-b213-753bfc338fd0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:13:21.107847 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:21.108636 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:21.110026 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-8fb463a5-c94c-483f-b793-4a9025e3ba4e req-e2c9b7ab-1bdd-44fe-84cf-ae2e1fdff2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33aecd2-362e-4c07-b17c-3fac08e6bf5e", "tag": "9f278e8e-27d2-4cfb-8a3e-fc9188a781fa"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:13:21.114963 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:21.115452 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:21.115894 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:21.116591 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:21.117921 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:21.118359 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:21.120902 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-8fb463a5-c94c-483f-b793-4a9025e3ba4e req-e2c9b7ab-1bdd-44fe-84cf-ae2e1fdff2e7 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:21.121604 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-8fb463a5-c94c-483f-b793-4a9025e3ba4e req-e2c9b7ab-1bdd-44fe-84cf-ae2e1fdff2e7 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:21.122268 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-8fb463a5-c94c-483f-b793-4a9025e3ba4e req-e2c9b7ab-1bdd-44fe-84cf-ae2e1fdff2e7 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:21.134862 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-8fb463a5-c94c-483f-b793-4a9025e3ba4e req-e2c9b7ab-1bdd-44fe-84cf-ae2e1fdff2e7 service nova] Creating event network-changed:9f278e8e-27d2-4cfb-8a3e-fc9188a781fa for instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e on hv-cinder-83976 Sep 14 20:13:21.139977 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-8fb463a5-c94c-483f-b793-4a9025e3ba4e req-e2c9b7ab-1bdd-44fe-84cf-ae2e1fdff2e7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033897 Sep 14 20:13:21.140575 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 596/1218] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 20:13:21.145354 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Going to try to terminate instance {{(pid=132861) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 20:13:21.432308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-20d9f2cf-148b-4f6c-87e4-ed717dc8e97e tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 204 len: 0 microversion: 2.1 time: 0.323530 Sep 14 20:13:21.432308 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 623/1219] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:13:21 2022] DELETE /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 20:13:21.437288 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:21.438269 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:21.444405 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:21.444888 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:21.445322 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:21.451449 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:21.452017 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:21.452468 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:21.592455 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.policy [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132862) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:13:21.600660 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-33d48b95-a15c-4e37-b5af-09db4525d423 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1574 microversion: 2.1 time: 0.167527 Sep 14 20:13:21.601592 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 597/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:21 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:13:22.624160 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:22.624861 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:22.631322 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:22.631793 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:22.632222 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:22.632900 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:22.633349 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:22.634275 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:22.832276 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:13:22.840714 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-67d90feb-1d15-49bc-964f-fe97a6b1a50c tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1574 microversion: 2.1 time: 0.220900 Sep 14 20:13:22.845761 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 624/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:22 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:13:23.670302 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [req-38707973-77fa-41b6-bff0-490b86417738 req-eb78ff39-1c6e-4c5b-9000-a654664b85a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33aecd2-362e-4c07-b17c-3fac08e6bf5e", "name": "network-vif-deleted", "tag": "9f278e8e-27d2-4cfb-8a3e-fc9188a781fa"}]} {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 20:13:23.681125 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-38707973-77fa-41b6-bff0-490b86417738 req-eb78ff39-1c6e-4c5b-9000-a654664b85a1 service nova] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:23.684985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-38707973-77fa-41b6-bff0-490b86417738 req-eb78ff39-1c6e-4c5b-9000-a654664b85a1 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:23.684985 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [req-38707973-77fa-41b6-bff0-490b86417738 req-eb78ff39-1c6e-4c5b-9000-a654664b85a1 service nova] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:23.693032 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.compute.server_external_events [req-38707973-77fa-41b6-bff0-490b86417738 req-eb78ff39-1c6e-4c5b-9000-a654664b85a1 service nova] Creating event network-vif-deleted:9f278e8e-27d2-4cfb-8a3e-fc9188a781fa for instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e on hv-cinder-83976 Sep 14 20:13:23.698435 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [req-38707973-77fa-41b6-bff0-490b86417738 req-eb78ff39-1c6e-4c5b-9000-a654664b85a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032004 Sep 14 20:13:23.699013 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 598/1222] 10.222.0.42 () {64 vars in 1317 bytes} [Wed Sep 14 20:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 20:13:23.864306 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:23.865007 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:23.872450 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:23.872654 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:23.873116 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:23.874019 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:23.874506 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:23.874958 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:23.942750 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.policy [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35e2c522107f4744b8357889a07595eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22037e56af1445c3a88064031d7d4254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132861) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 20:13:23.951146 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-231138f1-8d7e-4a34-93f0-1ce1da8c2601 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 200 len: 1223 microversion: 2.1 time: 0.090677 Sep 14 20:13:23.951708 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 625/1223] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:23 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 20:13:24.975192 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:24.975889 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: f33aecd2-362e-4c07-b17c-3fac08e6bf5e] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:24.982482 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:24.982966 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:24.983401 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:24.984085 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:24.984539 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:24.984965 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:24.998583 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] HTTP exception thrown: Instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e could not be found. Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Request method failure captured: Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e HTTP/1.1 Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjQzsugM4qYiCjUIcmzJsGsdl6_CkBTwlZb1nNTP60-ox_RPWeOQLEX29ArnxJo5s8NYp7UuCLAn6M8JBNte5W4nHxelZUAMm_ys5tOBqyQUnjBy9CcilSEZ2XHdjKVPx65kUIoaW6_Nlh5aIuWHZB5BbLIvj2h7HOsSPo0sj2_-0Sc Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:13:25.000234 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_22037e56af1445c3a88064031d7d4254", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/22037e56af1445c3a88064031d7d4254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}] Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 35e2c522107f4744b8357889a07595eb Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e could not be found. Sep 14 20:13:25.004544 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'f33aecd2-362e-4c07-b17c-3fac08e6bf5e'} Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e could not be found. Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:13:25.005517 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e could not be found. Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e could not be found. Sep 14 20:13:25.007432 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.008841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Returning 404 to user: Instance f33aecd2-362e-4c07-b17c-3fac08e6bf5e could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:13:25.008841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-c180cac9-4f71-4930-92c9-ea7908295702 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e" status: 404 len: 111 microversion: 2.1 time: 0.031094 Sep 14 20:13:25.008841 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 599/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:24 2022] GET /compute/v2.1/servers/f33aecd2-362e-4c07-b17c-3fac08e6bf5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:13:25.496691 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:25.497184 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.compute.api [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132861) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:25.503752 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:25.504236 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:25.504692 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:25.505379 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:25.505857 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:25.506286 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG oslo_concurrency.lockutils [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:25.520171 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.wsgi [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] HTTP exception thrown: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Request method failure captured: Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: request: DELETE /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec HTTP/1.1 Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept: application/json Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Accept-Encoding: identity Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Connection: close Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Length: 0 Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Content-Type: application/json Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Host: 10.222.0.42 Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: Openstack-System-Scope: None Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: User-Agent: python-urllib3/1.26.12 Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Auth-Token: gAAAAABjIjQzsugM4qYiCjUIcmzJsGsdl6_CkBTwlZb1nNTP60-ox_RPWeOQLEX29ArnxJo5s8NYp7UuCLAn6M8JBNte5W4nHxelZUAMm_ys5tOBqyQUnjBy9CcilSEZ2XHdjKVPx65kUIoaW6_Nlh5aIuWHZB5BbLIvj2h7HOsSPo0sj2_-0Sc Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Id: None Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Domain-Name: None Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Identity-Status: Confirmed Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Is-Admin-Project: True Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Id: default Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Domain-Name: Default Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Project-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Role: member,reader Sep 14 20:13:25.521848 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Roles: member,reader Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_22037e56af1445c3a88064031d7d4254", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/22037e56af1445c3a88064031d7d4254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}] Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-Tenant-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Id: default Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Domain-Name: Default Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Id: 35e2c522107f4744b8357889a07595eb Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: X-User-Name: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: method: > Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: exception: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.523632 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: action_args: {'id': 'ff22969d-30fb-4694-9760-258964775fec'} Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:13:25.524584 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.526757 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.528505 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Returning 404 to user: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. {{(pid=132861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:13:25.528505 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1d419130-454c-422e-ac08-4257109317d2 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 404 len: 111 microversion: 2.1 time: 0.030548 Sep 14 20:13:25.528505 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 626/1225] 10.222.0.42 () {58 vars in 1239 bytes} [Wed Sep 14 20:13:25 2022] DELETE /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 20:13:25.532565 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '>' {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:25.533183 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.compute.api [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] [instance: ff22969d-30fb-4694-9760-258964775fec] Fetching instance by UUID {{(pid=132862) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 20:13:25.539162 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:25.539638 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:25.540073 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:25.540961 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Acquiring lock "0995e957-b33c-4c22-b06d-cfa91799dd59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 20:13:25.541241 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 20:13:25.541664 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG oslo_concurrency.lockutils [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Lock "0995e957-b33c-4c22-b06d-cfa91799dd59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 20:13:25.554654 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.wsgi [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] HTTP exception thrown: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Request method failure captured: Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: request: GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec HTTP/1.1 Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept: application/json Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Accept-Encoding: identity Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Connection: close Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Length: 0 Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Content-Type: application/json Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Host: 10.222.0.42 Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: Openstack-System-Scope: None Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: User-Agent: python-urllib3/1.26.12 Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Auth-Token: gAAAAABjIjQzsugM4qYiCjUIcmzJsGsdl6_CkBTwlZb1nNTP60-ox_RPWeOQLEX29ArnxJo5s8NYp7UuCLAn6M8JBNte5W4nHxelZUAMm_ys5tOBqyQUnjBy9CcilSEZ2XHdjKVPx65kUIoaW6_Nlh5aIuWHZB5BbLIvj2h7HOsSPo0sj2_-0Sc Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Id: None Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Domain-Name: None Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Identity-Status: Confirmed Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Is-Admin-Project: True Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Id: default Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Domain-Name: Default Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Project-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Role: member,reader Sep 14 20:13:25.556169 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Roles: member,reader Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_22037e56af1445c3a88064031d7d4254", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/22037e56af1445c3a88064031d7d4254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/22037e56af1445c3a88064031d7d4254"}]}] Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Id: 22037e56af1445c3a88064031d7d4254 Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-Tenant-Name: tempest-TestVolumeBootPattern-2113954319 Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Id: default Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Domain-Name: Default Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Id: 35e2c522107f4744b8357889a07595eb Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: X-User-Name: tempest-TestVolumeBootPattern-2113954319-project Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: method: > Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: exception: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.558152 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: action_args: {'id': 'ff22969d-30fb-4694-9760-258964775fec'} Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: {{(pid=132862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 20:13:25.559096 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. Sep 14 20:13:25.560730 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: ERROR nova.api.openstack.wsgi Sep 14 20:13:25.562523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: DEBUG nova.api.openstack.wsgi [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Returning 404 to user: Instance ff22969d-30fb-4694-9760-258964775fec could not be found. {{(pid=132862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 20:13:25.562523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: INFO nova.api.openstack.requestlog [None req-e62543a5-5001-42df-a520-957a9dec5927 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec" status: 404 len: 111 microversion: 2.1 time: 0.028980 Sep 14 20:13:25.562523 dv-cinder-839768-8-iscsi devstack@n-api.service[132862]: [pid: 132862|app: 0|req: 600/1226] 10.222.0.42 () {58 vars in 1236 bytes} [Wed Sep 14 20:13:25 2022] GET /compute/v2.1/servers/ff22969d-30fb-4694-9760-258964775fec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 20:13:27.043180 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: DEBUG nova.api.openstack.wsgi [None req-1d03d878-2631-45d3-bf94-ea3a177b70e9 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] Calling method '.version_select at 0x7f19e574e790>' {{(pid=132861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 20:13:27.137581 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: INFO nova.api.openstack.requestlog [None req-1d03d878-2631-45d3-bf94-ea3a177b70e9 tempest-TestVolumeBootPattern-2113954319 tempest-TestVolumeBootPattern-2113954319-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-542401345" status: 202 len: 0 microversion: 2.1 time: 0.098197 Sep 14 20:13:27.138229 dv-cinder-839768-8-iscsi devstack@n-api.service[132861]: [pid: 132861|app: 0|req: 627/1227] 10.222.0.42 () {58 vars in 1260 bytes} [Wed Sep 14 20:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-542401345 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)